This is very common in urban fixed gear culture, but our rides tend to be small and ad-hoc compared to the big organized road bike ones. I've done those a few times and was actively made unwelcome so it's not particularly surprising it's not extremely on your radar. Nonetheless my city has an active community a couple thousand strong that would consider it unusual to drive to a ride.