Yes, literally everyone, because that's how the law is written.
Note https://www.congress.gov/bill/118th-congress/house-bill/2436 - this would reclassify it from a civil to a criminal offense, but did not pass into law.
Also note that entry into the US after having been removed from it is, by law, a criminal offense.
----
> What about "illegally" parked cars? Those are also civil infractions.
You should note that nobody calls the people who put them there 'illegal drivers'. (We also don't apply that moniker to people speeding, failing to signal on a lane change, or being responsible for many other moving violations. We do apply it to people driving drunk or without a license - which are criminal offenses.)