Exactly. Which is why it would be an ad hominem (or really, ad feminum) to say "How can we possibly trust you as our CFO? You're a woman!" since there is no pertinent relationship between gender and the job's requirements. However, there's nothing illogical about saying "How can we possibly trust you as our CFO? You're a convicted embezzler!"
Indeed, if the personal considerations are this relevant, it would quite illogical not to consider them. Likewise, I someone has established a general reputation for idiocy, slop, and other crimes against lucidity, it's perfectly reasonable to flag their remarks as dubious until proven otherwise. It's actually a perfectly rational conservation of time and energy.
