My opinion is that everything which can have an address, can have it in OSM. And those barns have an address. It would be incorrect to remove the correct data.

Search isn't the only way to use OSM data.

We could add a new tag for the main building.

Also, remember that cafes, shops can be mapped separately from the building and can have an address too, which will duplicate the address of the building.

