Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
iwd
2y ago
0 comments
Share
Do you have compression enabled? At least from Pandas, Parquet defaults to compressed and Arrow/Feather default to uncompressed. When I enable zstd compression, I get similar file sizes, and sometimes Arrow is smaller.
0 comments
default
newest
oldest
slt2021
2y ago
I was just trying pandas native .to_parquet and .to_arrow() without any extra config knobs
j
/
k
navigate · click thread line to collapse