Yes, many people find these touch screens annoying, and they’ll tend to buy cars with physical controls. But just like people who prefer physical keyboards on their phones, these consumers are a vocal minority who aren’t big enough to cater to.
If touch screens make cars less safe, then we should see higher liability insurance rates for such cars. So far that doesn’t seem to be the case.