The majority of people might not want to move state, which is fine, but they prevent other people from exercising their right to freedom of movement.
But this ends up being bad for everyone - if we are agreed that competition is good, this prevents competition between sovereign states for labour and population.
As an individual, I am stuck with whatever citizenship I was born into - and I have practically no opportunity to revoke my citizenship or try to claim a different or better citizenship. This is absolutely a derogation of a basic human right. I see it as no different morally than, for example, a caste system.