undefined | Better HN

0 pointsLammy5mo ago0 comments

I do like to deduplicate my BitTorrent downloads/seeding directory with my media directories so I can edit metadata to my heart's content while still seeding forever without having to incur 2x storage usage. I tune the `recordsize` to 1MiB so it has vastly fewer blocks to keep track of compared to the default 128K, at the cost of any modification wasting very slightly more space. Really not a big deal though when talking about multi-gibibyte media containers, multi-megapixel art embeds, etc.

0 comments

zenoprax5mo ago

Have you considered "reflinks"? Supported as of [OpenZFS 2.2](https://github.com/openzfs/zfs/pull/13392).

Haven't used them yet myself but seems like a nice use case for things like minor metadata changes to media files. The bulk of the file is shared and only the delta between the two are saved.

LammyOP5mo ago

Neat; will look into this. My setup is several years older than this, predating even FreeBSD's move to OpenZFS, and I just haven't touched the config of it since then since it works flawlessly (and since I already bought the RAM lol)

yegle5mo ago

cross-seed | cross-seed https://www.cross-seed.org/

bscphil5mo ago

I believe they are saying they literally edit the media files to add / change metadata. Cross-seeding is only possible if the files are kept the same.

j / k navigate · click thread line to collapse