In fact I think it's less safe for someone to be forced to cross memorial avenue and back - just because you don't want to put an unmarked crossing there.
I'm still waiting for a good reason why it shouldn't - which at this point would be a sign there that says "pedestrians may not cross here".