You may want to cover the whole building with parts. Some consumers ( https://streets.gl/ ) care only about parts and they also don't support the idea of having a default fallback building's tags when parts are missing.

https://wiki.openstreetmap.org/wiki/Simple_3D_Buildings
The entire building outline should be filled with building:part=* areas, tagged with their respective height and other attributes.