Is that not a standard feature?
My ~6 year old Jabra headphones connect to two devices simultaneously, and can easily switch between a total of five at the touch of a button. My Pixel Buds do the same (called 'multipoint' and 'audio switch').
Yeah, things were more awkward in the mid 2010s, but I'd expect everything from the current decade to be able to do it without issue.