If "average quality" in everyone of those things was not acceptable to you and you actually needed the best of the best, and best quality could not be had in most phones....then yeah that might make sense. I doubt anyone actually cares to have absolutely top tier performance in every one of those categories though, and what most phones have is "good enough". Which is why/how phones ate all those functions. They do most of them "good enough" and "good enough" is all that most consumers care about.
Caring about performance in at least one of those categories is not that uncommon and carrying a dedicated device for that isn't crazy. I have used stand alone GPS receivers before even when I had my phone, and deciding that you need a better camera seems not crazy at all.