That documentation will need to be shared, and the implementation of the rule change will need to be delayed until the disclosure window has passed.
But yeah, the product manager view / documentation of intent sounds generally reasonable.
I do wonder how useful that would be to the news orgs in practice.
But on the other hand, a bunch of journalists will have a ton of never-before-seen information about how the world's most powerful companies affect every other company on the planet. That alone is going to be worth some major exclusives.
Also, by the mere nature of being forced to share it, Google and Facebook will have to clean up their acts, they'll have to assume any change they make that could open them up to legal scrutiny will be found.
The search algorithm tells you the order of search results for a particular set of terms. Except that as input you need to feed it a graph of the entire indexed internet, which is re-indexed periodically as the content on the index changes. How does knowing that benefit new companies? What, exactly would your hypothetical full-time guy/team, equipped with that index at huge cost, tell their company that would justify the time and expense? That they should write interesting content that lots of people consume?
Second, the general approach has been published and is well documented [1], as are its susceptibilities to attack [2]. So there's your algorithm, what does it tell you?
Third, general SEO isn't the problem, it's coordinated attacks that can poison all search results / ads markets if enough detail is known. Google invests [3] heavily to address these areas [4].
Finally, you underestimate how much of a firehose you'd have to drink from. It describes all of the internet.
[1] http://infolab.stanford.edu/~backrub/google.html
[2] https://en.wikipedia.org/wiki/PageRank#Manipulating_PageRank
[3] https://www.quora.com/What-does-the-Counter-Abuse-Technology...
[4] https://www.blog.google/around-the-globe/google-europe/meet-...
> Furthermore, advertising income often provides an incentive to provide poor quality search results. For example, we noticed a major search engine would not return a large airline's homepage when the airline's name was given as a query. It so happened that the airline had placed an expensive ad, linked to the query that was its name. A better search engine would not have required this ad, and possibly resulted in the loss of the revenue from the airline to the search engine. In general, it could be argued from the consumer point of view that the better the search engine is, the fewer advertisements will be needed for the consumer to find what they want. This of course erodes the advertising supported business model of the existing search engines. However, there will always be money from advertisers who want a customer to switch products, or have something that is genuinely new. But we believe the issue of advertising causes enough mixed incentives that it is crucial to have a competitive search engine that is transparent and in the academic realm.
Larry and Sergey themselves both believed that ad-funded search was problematic, and that a transparent search engine in the academic realm was "crucial".
Unfortunately, Larry and Sergey's price was clearly billions of dollars.
