The problem I have with the touchbar isn't the existence of it, it's that apparently my keyboard posture is terrible and I float fingers up their periodically. Because there's no force requirement for activation, I would keep triggering buttons. I could turn it off, but there are a few of the command/f buttons I use regularly, and so am stuck with it.
Hence, it's a nuisance. Not something I go insane about like some do, but it is a very definite day-to-day annoyance.