I don't think anyone wants to filter sites that could be gamed with "100s of votes". We want to filter sites that will require tens of thousands of votes to get rid of.
And even then it should consider the votes themselves to be suspect and watch for blocks of users who only vote in unison (qualitatively and temporally).