This, plus in several years we will observe many MVPs generated (partially) by LLMs that will require fixing and further development. LLMs barely produce 1k lines of coherent code, riddled with bugs. Benchmarks are improving, but there is no breakthrough in handling real, large codebases. I have no idea about the future job market, but the quality of the "material" we work with will be quite poor.
I don't think these companies are generating MVPs using LLMs. They're just using LLMs to assist in coding. A human reviewers is there. And in a few years, LLMs might be so good that they can fix mistakes by 2024 LLMs.
To clarify, LLMs will lower the entry barrier for non-programmers to test new ideas (which is good). Later, those successful projects will require development by professional developers. I suspect that many of these projects will have lower quality than regular proof-of-concept projects today.