I think with genAI specifically, a whole lot of the distrust comes from two things: the movement on this front is coming from SV, which has earned a lot of distrust from the general public, and the major players in genAI (particularly OpenAI) have themselves been very clear that they believe the tech is dangerous and they're intentionally gambling with the lives of everyone else.
That, and when people have expressed their natural fear that genAI and LLMs will adversely impact their abililty to make a living, a common response -- especially early on when the fear was much higher -- from the pro-AI crowd is (paraphrasing) "too bad, you can't stop progress". That's not a reasonable response, and it's one that effectively says "you don't matter, sucks to be you." It's not far from saying "AI is your enemy."
