The rules are made by politicians.
All it takes to change the rules is to rotate politicians.
Or enough public dissent that the same politicians are forced to revert the rules.