You might be getting cached tiles still - it only takes a couple of minutes for them to render, but you need to convince your browser to go grab the new ones.

https://wiki.openstreetmap.org/wiki/Browser_cache