Lets say you try to explain quantum physics to a lay person. We know quantum mechanics is basically correct, but it sounds batshit insane if you try to go directly to the conclusions of quantum mechanics without starting at the first principles. You can't just go from A-Z, you have to go A-B-C...Z. The average lay person just goes from A->"wow quantum physics are weird, murdering cats and stuff"
The thing is, we can believe some of the more outlandish claims of physics because physics is a trusted institution and we know claims are checked, etc, so we don't need to check it ourselves.
So that works for science; because smart people made it work, but what happens with things that aren't science? The same people smart enough to study quantum physics might also be just as interested in politics. So maybe their thoughts start at the mainstream, but they keep growing sideways off it in their own unique branch. In science, these branches get clipped when they're falsified by the community, but other areas don't really have a bar for determining the correctness of a theory, those branches don't necessarily get trimmed.
Anyway, I guess my point is that if you know a very smart person and they're saying something seemingly insane, what you're probably hearing is step Z in their thought process, but for it to make sense you have to hear the preceding chain of thoughts A..Y that led to that. Not to say their theory is right, it probably is loony, but since they probably haven't gotten anyone to critique their A..Y coherently, when they get called a crackpot they probably rightly assume that nobody quite understand what they're getting at.
