Culturally from a young age we're told to not trust our guts and a lot of people shut them off.
"Don't judge a book by the cover", "you don't even know him". We're told to ignore our gut feeling especially if that feeling is consistent with negative stereotypes.