Modular phones were tried and were a complete market failure. Because they sacrifice thinness, robustness and water proofing.
Older standards are removed because they are not used anymore, so the bandwidth is freed for newer ones.
And "people don't really want it" remains just as true. Just like people didn't want small screens, until even Apple famously yielded.