Ingesting 1Gbps of logs into ClickHouse for $180/month (opens in new tab)

(opendata.dev)

18 pointsapurvamehta28d ago3 comments

3 comments

3 comments · 1 top-level

mannyv27d ago· 2 in thread

You don't really need clickhouse in this pipeline. And it's interesting (but obvious once said) that you can replace kafka with s3...at least in the "scalable and reliable destination for lots of data" dimension.

apurvamehtaOP27d ago

It's a demonstration. Kafka is a very popular input for Clickhouse. So are data lakes. The point is neither need Kafka at all.

mannyv25d ago

That's how far s3 has come - it's replacing products that were the pinnacle of scalability back in the day.

I have to look a bit, but it could probably replace Cassandra now as well.

j / k navigate · click thread line to collapse