If you're worried about from poorer areas coming in and taking our jobs, how much distinction is there
really whether they come from a poorer state or a poorer country?
America has free and open trade within its borders. Nobody seems to mind that there are no visa restrictions on someone from Mississippi taking a job in California.
The distinction we make between a foreigner coming to take a job and a domestic worker taking a job is (with some particular exceptions) is largely a mental construct.