> Well, if the privatized version doesn't [risk loss because of] the point of a gun
Except it does. A soldier with a gun in your face can take your insurance payout just as easily as they can take your bank balance.
With respect to a kleptocracy, neither option protects you.
> take my money away from me
Ah, this is the place where you've confused an apple for an orange: The premiums collected for "destitute in a ditch" insurance is not "your money", because that's not how insurance works.
Similarly if you buy "house burns down" insurance and your house is fine until the day you sell it, then you get zero dollars back from the insurance company and nobody blinks an eye. Your payout is potential, conditional, and generally non-transferable, and that's normal, because an insurance policy is not an investment account.
There was never a discrete "your money" pile sitting around in the insurance-company vault waiting for you to reclaim it. (Well, aside from in the minds of criminals plotting insurance fraud.)