I've just changed them all to simply "name", which I think is reasonable, but "building:number" might make more sense. I'll be adding more in a few days so I'll consider changing all the tags then.

You may well be right that routing tools are not interested in the data, but it's really useful simply visually, rendered on a phone screen, for someone who's on site and told "meet me at hut 18".