Some people wouldn't want to run businesses in a Spanglophone territory where shipping is more expensive and electricity can be spotty. The local economy may not be quite as strong depending on your industry, and meanwhile you're sending your kids to private schools because the public ones are questionable. Hospitals are less efficient and many government functions, including the ones with which your company interacts, are slow. Supermarket items cost more than they do in the contiguous states, as do gasoline, natural gas, and electricity. And you will need a car because public transportation is not so good, and often nonexistent. Culturally, there's a very relaxed vibe and a strong sense of economic pessimism, which isn't exactly the hopeful and driven mentality that you may want for a startup.
So maybe you're paying less in taxes but your lifestyle, company culture, and ease of doing business worsen. #tradeoffs