undefined | Better HN

0 pointskwillets1y ago0 comments

One more: do you prefer the CDC technique over using the rowgroups as chunks (ie using knowledge of the file structure)? Is it worth it to build a parquet-specific diff?

0 comments

ylow1y ago

I think both are necessary. The cdc technique is file format independent. The row group method makes Parquet robust to it.

j / k navigate · click thread line to collapse

0 pointskwillets1y ago0 comments

One more: do you prefer the CDC technique over using the rowgroups as chunks (ie using knowledge of the file structure)? Is it worth it to build a parquet-specific diff?

0 comments

ylow1y ago

I think both are necessary. The cdc technique is file format independent. The row group method makes Parquet robust to it.

j / k navigate · click thread line to collapse