Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
iwd
2y ago
0 comments
Save
Share
Do you have compression enabled? At least from Pandas, Parquet defaults to compressed and Arrow/Feather default to uncompressed. When I enable zstd compression, I get similar file sizes, and sometimes Arrow is smaller.
0 comments
1 comments · 1 top-level
top
newest
oldest
slt2021
2y ago
I was just trying pandas native .to_parquet and .to_arrow() without any extra config knobs
j
/
k
navigate · click thread line to collapse