Did you consider adding a small screen?
I've always hated bluetooth keyboards until I built a Zaphod (which also runs ZMK). And just being able to see battery estimate, whether it is trying to pair, or which device it is currently connected to has made it a much smoother experience.