All of your "polite" behavior is modified by shame. To use an extreme, contrived, example if you shit on the floor your parents probably shamed you into using the restroom properly. You can, of course, continue to shit on the floor but you also can't act with such righteous indignation when no one wants you around. Perhaps you find a group of people who shit on the floor. But then they, too, will have their own shame-based norms that will you either comply to or be ostracized from the group.
Now, scratch the example of shitting on the floor and replace it with any other behavior. Depending on the group you belong to (or are trying to belong to) shame is an effective way in enforcing expected behavior. It's one of the things that separate us from other animals. If you don't respond to shame (rather than just acting like it) you are not quirky and original you are likely a sociopath.