I was about to mention this, but I thought it seemed too obvious. Nobody wants to come out and say that they are in favour of such material, especially to decriminalise it, except maybe a fringe party such as the Pirate Party. I have heard it may be similar to the law in Japan mandating that genitals be censored - no politician, Japanese or otherwise, wants to be "the one" to stand up and argue against it, I think anyway.
So perhaps "people don't care" isn't sufficient and a mistake on my part, though I have spoken to people who say that they are "not concerned" about the topic, despite being rather liberal in terms of freedom of expression otherwise.