undefined | Better HN

0 pointsthreeseed3y ago0 comments

But many people including the OP think it is.

It’s like me running a web crawler on my phone and saying I can replace Google.

0 comments

If you were able to index the same amount of content you'd have a damn good alternative. And that's the level of this experiment.

It is trivial to index the same amount of content as Google as the web is mostly static.

The hard part is in being able to translate a search query into a list of pages.

And that requires a level of sophistication that far exceeds a laptop.

It is not trivial at all. That is a huge amount of scraping.

Any machine that can do that will be a similar spec to what you need for serving queries. Not as fast as google does it, but a good amount of them.

It is trivial compared to the task of translating a user query into search results.

It's akin to saying the magic behind OpenGPT is the dataset.

What? The OP covers much more than "just shuffling tweet sized buffers to network offload cards"

j / k navigate · click thread line to collapse