If JS, absolutely needed JQuery in order to, say, select an element the way C needs a library to output to the console, then sure, you may have an argument here.
But, no.
Thankfully node.js is bringing this clusterfuck to the desktop too.
But I agree, overall.
This is still a shame if you're maintaining a heavyweight alternative to jQuery or React which is far too obscure to be a consideration for browser vendors, but it's a big boon for users, especially users on slow or metered connections that download several different version numbers of jQuery from several different CDNs every day.
If you like, there could be mutually agreed upon standard repository that browser vendors routinely update from.
Sure, your less popular experimental library won't be in the list, that's what "<script src=..." is for.
It probably won't happen but it is hard to defend the position that it is a bad idea, I think.