undefined | Better HN

0 pointsyellowapple6y ago0 comments

And to that point, DDG does have its own crawler, and I believe leverages other third-parties as well (I know Yandex was historically in the mix, for example). So if Microsoft did try to strongarm DuckDuckGo, DDG would have other options, even if less-than-ideal.

0 comments

2 comments · 1 top-level

skinnymuch6y ago· 1 in thread

There’s no one close to Google in the US. After a big drop, there’s no one REMOTELY close to Bing for 2nd best results. Bing dropping DDG in 2020 or 2021 would be a death kneel for them for US search results. Probably many other countries too. Yandex is too far off right now to be a replacement. I haven’t checked Yandex in a bit of time though. Perhaps they drastically improved.

People in tech circles always say DDG has a crawler. I know they do. No one ever says how big it is. I have a hard time believing it’s crawling more than a couple percent what Bing is crawling.

yellowappleOP6y ago

> No one ever says how big [DuckDuckBot] is

One complicating matter is that it specializes in DDG's "Instant Answers"; apparently¹ the "source from other search engines" approach really only applies to the traditional results list, while DuckDuckBot is focused specifically on the Instant Answers, effectively optimizing for the absolute most relevant first result possible. So in its current state DuckDuckBot ain't exactly comparable in purpose.

Still, I don't see much that'd be stopping DDG from ramping this up and having it generate the traditional list of results, too. Yeah, obviously the results for quite a few queries will be far from ideal, but if the query already hits one of DDG's curated data sources, I suspect the results might already be better if anything.

----

¹: https://help.duckduckgo.com/duckduckgo-help-pages/results/so...

j / k navigate · click thread line to collapse