If female grad students were inviting him over for booty calls I think the tone of the conversation would be much different.

But the claim is that he was making advances on people who didn't welcome them. This is especially a problem since he was an influential professor with power over their careers.

Even for professors, where the natural state for many is social awkwardness, you have some obligation to read the signs of when your behavior is unwanted.