I would turn these banners off, but as far as I can tell, there is no way to get badges to show up on the icon (only other cue to remind me people want to talk to me) without these banners.
I really wish there was a 3rd party client that was all native that I could use. Teams is definitely the worst part of my software stack.