Restricting nazi flags also restricts pride flags.
The question is "Would you be okay if I hung flags?"
What about other forms of displaying support? Are posters just a cheaper flag?
Otherwise all you're doing is saying "this neighbourhood only allows support for these politics".
Are you sure you want to go that way?