Exactly: when people are unhappy and decide they're going to remove the heads of the ruling class, "but <some other system> is worse!" is some gallows humor while they do it.

Which has historical precedent: the French revolution wasn't a well planned transition to a better system, the Russian revolutionaries overthrowing the Tsar weren't much interested in the specific details of communism.

If the defense you have for the suffering of people is "well it could be worse" you are rather gambling that they are not yet sufficiently unhappy that the effort to be rid of you won't seem worth it.