My one mega-annoyance is no mute button. Not being able to mute a Zoom call (or a phone call) using just the Airpod hardware interface is... annoying. I don't use Siri that often and would honestly remap long click as mute/unmute. I'm willing to pay premium for that feature alone. Hell, I'm willing to subscribe that feature. Apple, "take my money", just give me a mute button that works without the phone (or watch, or laptop).
The worst part about the click is that it hangs up your call. I was on hold with the IRS for 3 hours and hung up on the representative when I adjusted my airpod. Rage inducing!