SQLite on Git, Part II: Unlocking Zlib's Less Known Feature (opens in new tab)

(blog.lysk.tech)

6 pointsmlysk1mo ago1 comments

1 comments

mlyskOP1mo ago

Part 2 of my blog series on running SQLite databases directly on Git storage.

This post explores how to use zlib's Z_FULL_FLUSH flag to enable random access in Git's compressed objects, making it possible to read subsets of large files without decompressing the entire object.

Prologue: https://blog.lysk.tech/sqlite-on-git-prologue Part 1: https://blog.lysk.tech/sqlite-on-git-part-1

Github repo: https://github.com/martin-lysk/talepack

j / k navigate · click thread line to collapse

1 comments

mlyskOP1mo ago

Part 2 of my blog series on running SQLite databases directly on Git storage.

This post explores how to use zlib's Z_FULL_FLUSH flag to enable random access in Git's compressed objects, making it possible to read subsets of large files without decompressing the entire object.

Prologue: https://blog.lysk.tech/sqlite-on-git-prologue Part 1: https://blog.lysk.tech/sqlite-on-git-part-1

Github repo: https://github.com/martin-lysk/talepack

j / k navigate · click thread line to collapse