The crucial difference is that pot users don't suffer from the massive U-turn. Rather, they celebrate it. They're the ones who lobbied for the change.

Suddenly making people happy and freer is fine. Suddenly making them miserable and taking away their longstanding rights is another matter.

It's the same thing with women getting the right to vote in 1920. Women themselves wanted it and lobbied for it!