undefined | Better HN

0 pointsploppyploppy3y ago0 comments

What project?

Do you mean polars reading Parquet into DuckDB to process that amount of data?

0 comments

Internal. We're using Polars as the query engine to effectively query that data statically at rest (more accurately, mmap'd on disk in arrow ipc format)

j / k navigate · click thread line to collapse

0 pointsploppyploppy3y ago0 comments

What project?

Do you mean polars reading Parquet into DuckDB to process that amount of data?

0 comments

jmartin26833y ago

Internal. We're using Polars as the query engine to effectively query that data statically at rest (more accurately, mmap'd on disk in arrow ipc format)

j / k navigate · click thread line to collapse