First: we may have gone too far toward anti-pollution. China has more naval vessels than the US. Everything changes when peace isn't a foregone conclusion, as it has been for the past 30? 50? years.
Second: it's not the regulations per se, but the difficulty of dealing with the bureaucracy, particularly (a) long delays and (b) uncertainty.
I run an electrical contractor, so this is not the least bit theoretical to me. The hassle of dealing with local government and PG&E for what should be routine things adds tremendous cost to doing business. Recent concrete example: it cost over $1,000 and two months to process a minor change to an electrical permit set, in Alameda (City). The actual change was moving some panels outside, a small revision to a plan that had already been checked and permitted. This required $1,400 in engineering fees, plus a ~$200 application fee to the City, and then the actual plan check and review charge of $650-700. It was probably one hour of actual work. The worst part was that Alameda outsources its plan check to a third party and I'm pretty sure the plans sat for two weeks on someone's desk at the City, before I asked for status, and then, an hour later, by "complete coincidence", it was sent to the outsourced plan checker.
If we could put a precise price on pollution, it would be a different story. It's a collateral damage of all the (even well-intentioned, good) regulation that drives business away.