undefined | Better HN

0 pointsn1xis10t24d ago0 comments

Sounds like blekko had a larger impact on the early urls than I thought. Out of curiosity, do you remember how large blekko’s index was at it’s peak?

0 comments

ccgreg24d ago

The largest index we had was 4 billion, which is tiny. Our crawl frontier was much larger.

j / k navigate · click thread line to collapse

ccgreg24d ago

The largest index we had was 4 billion, which is tiny. Our crawl frontier was much larger.

j / k navigate · click thread line to collapse