This very much depends upon whether you want the latest OpenGL 4.x features or not. Compute shaders, etc. Most people won't notice, but if you want to develop or use applications using these features, the open drivers aren't yet up to par, so for these cases it is indeed a major downgrade.