That's true, and I'd venture that it's nearly always true, with the main exception being when people feel unsafe and security becomes #1.

However, public opinion alone doesn't drive policy. There is also elite opinion. Elite opinion may shift on this, and if it does then there will be policy changes, though perhaps not profound ones.