I know for a fact my drivers do not phone home. The only GPU driver I've used for years is the one that comes in the linux kernel. It's open source, I haven't read all the code, but I know I could and I know the developers wouldn't be phoning home.
I'd bet a large number of linux users are in this situation since nouveau (nvidia), intel, and amdgpu drivers all exist in the linux kernel and work well.