Personally I don't find it problematic to talk about female privilege at all. I think one has to be careful (just as women have to be careful talking about male privilege) but there are areas where it is so blatant and damaging that it must be talked about, particularly in areas of domestic violence.
When I was just out of college, I was (as a male) the victim of some pretty intense domestic violence several times a week for about six months. It was a very hellish situaiton, but one thing that made it a lot worse was the sense that if I went to the authorities, I would be blamed for the attacks against me. Yet I was assaulted with lethal weapons (knives mostly) several times a week.
Nobody can tell me that there aren't key areas where female privilege doesn't exist. The problem is that it is as invisible to females as male privilege is to males.