Right, I should have spelled that out - the listener gets to count subconsciously only because the players are counting very consciously.
Playing music has changed my listening, and not necessarily for the better. I'm sometimes counting or listening for structural and composition elements in a way that can be distracting from just enjoying the sound/vibe.