There's more than enough of them to materially affect election outcomes. The number of votes you'd have to change to flip the outcome of the last few elections was very small, and the parties have a very good idea of which locations they'd have to disturb to achieve the greatest effect.
Now imagine you're a voter who shows any signal of potentially being Dem-aligned - for example a slightly darker complexion, or maybe dyed hair. On your way to the polling station, masked ICE goons "scan your face" with their AI apps, and the apps tell them you're illegal, so they put you into a van and drive you to a holding facility.
What recourse do you have? Even if they let you go the next day, you've lost your vote. And that's not a given, what if they hold you for weeks or months? How many people have others who depend on them, so they can't risk this?
I don't mean to sound dramatic, but if anything like this happens (and there's basically no way it won't) the fascist takeover is complete, and your only recourse left is civil war.