Why would an Allo/Duo user ever want to join a server, or something analogous? They just want to call or message their friend. I think it's obvious to merge some of their consumer point to point apps, but criticizing their group chat solution because they have consumer point-to-point apps is wrong.
Do you never want to talk to more than one person? I don't see why talking to one person is one app but adding another person means we need to stop, hangup, open a new app and reconnect.