The trouble is that generally people don't make this leap automatically, and simply noting a problem doesn't come with an implied "therefore ban it." Generally the people who do automatically make this leap have authoritarian mindsets, for whom personal preferences and public policy are nigh inseparable. Watch out for these kind of people, they would likely impose their preferences on you if they ever gain power over you, without even thinking about it. The emperor doesn't care for pre-tattered jeans, therefore he bans them for everybody else too; not a good sort of man to have in charge.
Now, the pertinent question is which of these sorts is Peter Thiel? When this self-espoused libertarian says "X is bad for me" does that necessarily imply that it should be banned for everybody else as well? Is there evidence for him behaving in a way that betrays this kind of authoritarian mindset?