I think ~50 years ago referred more to this type of thing, while stuff like voting rights was just included since it's relevant to the struggle as a whole.
What I'm saying is, I doubt he thinks they couldn't vote in the '60s. I think he just used ~50 years ago earlier in his comment and then later on was mentioning some of the other struggles, like voting.