That is a good question. I think the biggest difference is that humans have access to sensory data that grounds us in reality. If you put a human in complete sensory deprivation, I think we would hallucinate much more.