Welcome to OSM, and thanks for your contribution. building=* ways are supposed to match the footprint of the actual building, and not the plot - I went ahead and remapped the address as a node, and added the streets without names. Hope this helps with your troubles (although it probably won't for Google and Apple maps, specifically)