I frequently ask speakers of my native Flemish where they're from because they have interesting regional accents or speak baffling dialects. And that's a language spoken by barely 6 million people. Feeling an "alien in your own country" because you don't speak a language in the exact same way as the people around you ... seems very counterproductive.
These people are natives with dialects. As an immigrant you face prejudices sometimes and being in a negative interaction makes you more wary of the other parties intent.