Yes, every gigantic new secret police force answerable only to the executive is created to "catch criminals" or "deport immigrants" or do whatever else people will accept, until said police force's mandate is morphed as needed. That is why so many 2A defenders are (rightly) skeptical of large domestic police forces answerable to the executive branch, which is what ICE is; it's also why so many defenders have been skeptical of the FBI, ATF, and so on. The only people who think the mandate won't adjust as needed are, to be blunt, trusting patsies, which is not what 2A defenders have historically been.
The creators and defenders of the second amendment were and are smart people. They were skeptical of highly concentrated power, which is why we have a federalist system; they were also highly skeptical of large concentrations of militarized police power, which is why our police in general are run by states and municipalities. It is really quite difficult to reconcile support of a massive ICE apparatus with any sort of comprehension of the political philosophy of the US constitution.
