It's interesting that you bring that up. Because we are having a very similar discussion at the moment about symbols of the Red Army and Soviet Russia - for good reason, as you can imagine.
It has caused quite a stir and a lot of panel discussions, not least at our university. In the meantime, Soviet war memorials are being removed, their symbols torn down. But what will become of all the "Hämmer und Sicheln" that still decorate many facades from the Stalin era?
A better approach would be to provide the monuments and houses with explanatory plaques that try to explain to future generations why this symbolism is not as innocent as it soon might appear.
In general, I am against bans and believe it takes more than that. (The white Z is still banned at demonstrations here).