The problem isn't when one company pays better than everybody else. The problem is when the top ten different companies, all of which you would like to work for and all of which pay the best, agree with eachother that none of them will pay you what you are worth.
Now, I think you already understand that, and your counter was "well then someone will hop in and pay you what you are worth and they will suffer for colluding". But clearly that hasn't happened.
Seriously, the fact that the word "collude" can even be used here is a bad sign. If you pay attention to business history, that word is never good.