undefined | Better HN

0 pointsepgui1y ago0 comments

I don’t think they were talking about the quality of Google search results. I believe they were talking about how the data was processed by the wordfreq project.

0 comments

kevindamm1y ago

I was actually referring to the data ingestion for training LLMs, I don't know what filtering or weighting might be done with wordfreq.

j / k navigate · click thread line to collapse

0 comments

kevindamm1y ago

I was actually referring to the data ingestion for training LLMs, I don't know what filtering or weighting might be done with wordfreq.

j / k navigate · click thread line to collapse