Pgwarehouse: Easily sync your Postgres db to a Snowflake or ClickHouse warehouse (opens in new tab)

(github.com)

6 pointsscottpersinger3y ago4 comments

4 comments

Interesting tool! I am curious about this feature: https://github.com/scottpersinger/pgwarehouse#last-modified in Clickhouse. Have you tested it on big tables and how well does it perform?

scottpersingerOP3y ago

Built this recently to help a friend setup a Snowflake warehouse from their Postgres database. Also tested it with ClickHouse which is cool for running locally. Uses simple COPY which is fast and doesn't require binlog access, but doesn't support real-time replication as a result.

tylerhannan3y ago

Super interesting, I look forward to playing with it.

FWIW, the Community Integrations section of https://clickhouse.com/docs/en/integrations is open for PRs if you want to add it ;)

scottpersingerOP3y ago

cool - will do!

j / k navigate · click thread line to collapse

4 comments

higeorge133y ago

Interesting tool! I am curious about this feature: https://github.com/scottpersinger/pgwarehouse#last-modified in Clickhouse. Have you tested it on big tables and how well does it perform?

scottpersingerOP3y ago

tylerhannan3y ago

Super interesting, I look forward to playing with it.

FWIW, the Community Integrations section of https://clickhouse.com/docs/en/integrations is open for PRs if you want to add it ;)

scottpersingerOP3y ago

cool - will do!

j / k navigate · click thread line to collapse