undefined | Better HN

0 pointsweberer1y ago0 comments

The article says they got datasets from Anna's Archive. It was most likely the scihub/libgen torrent which is 96.0 TB right now and contains 92,872,581 files. That's about 1 megabyte per file.

https://annas-archive.org/datasets

0 comments

1 comments · 1 top-level

southernplaces71y ago

Where does one find these torrent datasets? Did they download the books in bits and pieces or as a single huge multi-TB file?

j / k navigate · click thread line to collapse