I have so many edits, and I keep making mistakes so it's not a big deal. To remove just the business, use the remove icon next to the non existent features in the list of tags towards the bottom left hand side of the editor.

Or even easier, right click on the node or polygon the select the ⋁ to remove all but the address tags.