Thousands of people, if not more, felt Obama was illegitimate, and the Republicans certainly pandered to that crowd by embracing the Tea Party and using quasi-revolutionary rhetoric in their campaigning against him.
In their case, it was considered (or treated like) a moral duty to question the legitimacy of a sitting President... Why is it suddenly wrong for the other side to do the same?