In my opinion, many of these university buildings do have names, even if their name is a restatement of the address.

See e.g. the UVM map https://www.uvm.edu/map/ which says things like "479 Main Street - Address: 479 Main St." Also, my impression from having been and worked there was that everyone treated them as named.

On the other hand, a lot of this was out of date as you fixed up with renames, demolished buildings, etc. And that only applies to college buildings, I don't have any reason to think non-college buildings have names.