Without a high score, you don't get the best interest rates on loans. Or, might not be eligible for a security clearance (government work) or jobs in some industries (banking and other "high trust" fields). Or might not be able to rent an apartment.
But, the other response wasn't incorrect. We don't have debtors prisons (unless the debt is owed to the government, then they might be able to jail you).