If English communication is actually important for the job, then yes, people who can't adequately communicate in English can and should be discriminated against. And yes, people who can't adequately communicate in English tend to be born outside of English-speaking countries.
Requiring strong written English to carry boxes could be considered unfair. But for a job that involves written communication?