I believe what he's saying is that without the action of individuals within certain groups, it would be impossible for those in groups without power to progress. If they were uniformly racist and sexist, then progress could not have been made.
That's to say they are capable of it, not that it's ideal or that they were responsible solely for progress. Most abolitionists were not African-American.