That's not an ad hominem. You're attacking their argument, not them as a person.

An ad hominem would be like saying, "Oh yeah, well you're an alcoholic", for instance, as though that could discredit their argument even if it were true.

I know I am, but what... am... I?