I agree with you, which is why I started Bolt (shameless plug:
https://bolt.co). We are just getting started on our messaging app, which will be separate from our voice app due to the completely different use-cases.
The monolithic Hangouts app suffers from a bit of a Jack-of-all-trades problem. It's pretty good at four things, but not great at any single one.