I don't have a strong opinion either way, so I'm okay to leave them if you want.

I re-read https://wiki.openstreetmap.org/wiki/Key:railway regarding abandoned vs razed:

"The course of a former railway which has been abandoned and the track removed. The course is still recognized through embankments, cuttings, tree rows, bridges, tunnels, remaining track ties, building shapes and rolling or straight ways. For demolished rails that are no longer identifiable, e.g. that have been built over, some use the highly questionable railway=razed."

It don't know about here, but it seems like some places especially through houses are more railway=razed than railway=abandoned. To be abandoned would required at least some evidence visible by most people on the ground.