Solitary confinement is one of the worst punishments you give to a human. As you get richer your status will isolate you from other people because you don't share their particular kind of suffering.
One of the biggest problems is the fact that anything you can do can be done better by paying someone else to do nothing but the thing you want to do yourself.
