Same thing for aliens, imagine an alien refugee ship capable of FTL but needs a special fuel that it has to collect from deep Earth ocean very slowly, perhaps for a few million years because Earth only has very very few of such fuel. There is not much the refugees can do. They don't have weapons, they still habe to gather food and energy, they can't do a lot of bad things to locals (us)
