If you give people rights, capital will emigrate to other countries. Just look at outsourcing.
See, it is human nature that is flawed. There are always people on top and people below.
Immigration is allowed (both legaly and illegaly) because payment for some activities isn't a honest wage for an honest job. Why? Because the game is rigged. *
Not everybody can apply for venture capital investment. Being white helps. Being male helps. Having the correct background helps. Having a good idea helps. Making a good pitch helps a lot. Why? Because the game is rigged.
Those two generalizations should be enough.
*Why do border exists, again? To keep away the slave labor reserve until it is needed. Why can people from any country trade their labor? Because the game is rigged
For me, a fair game is when players win based on abilities and effort. However, the life game depends less on that than, which is not fair; furthermore, there is no rule manual and rules are rewritten while playing.
I am not picking a fight. If you want to say that poor people get what they deserve, this is an ongoing discussion.
More on borders. You can have catholics, jews and muslims inside the US, without then openly murdering each other. I applaud how they get that done in there. Your take on borders is called Xenophobia ("islamites will be terrorists" take), which is human nature, too.
Edit: for fairness' sake. I do have a perimetral wall around my property. I learned through life that most people can't be helped, but I still think you can help some. I draw my line to allow people a chance to prove their worth, which is still difficult as people around and above us can be racist or have their kin preferred.