You should NEVER specify locations relating to yourself or other people you know for yours (and others) personal safety.
A better changeset comment would be something like "Adding house address" without specifying it belongs to someone.

This wiki article on Good Changeset Comments might help you:
https://wiki.openstreetmap.org/wiki/Good_changeset_comments