Holy tangent Batman! I never said that, and I think your nitpicking insinuates that a majority of people in jail don't belong there. I agree that not everyone in jail deserves to be there, even if they did the thing they were convicted of. But jail space is a scarce resource so I doubt many people in jail are there for such trifles as 1 gram of marijuana.
Furthermore, even if someone was in jail over some nothingburger, they would still have more reason to expect to have a hard time with a criminal record and all than someone without a criminal record. This is really my point: If you did nothing wrong yet have difficulties finding a job, it is hard to feel like you have agency in your own life.