undefined | Better HN

0 pointsmapme3y ago0 comments

They did not spend half their revenue on compute. It’s more like 20-25% for running data enters/staff for DCs. Check their earnings report.

Whats app is not an applicable comparison because messages and videos are stored on the client device. Better to look at Pinterest and snap, which spend a lot on infra as well.

The issue is storage, ads, and ML to name a few. For example, from 2015:

“ Our Hadoop filesystems host over 300PB of data on tens of thousands of servers. We scale HDFS by federating multiple namespaces.”

You can also see their hardware usage broken down by service as put in their blog.

https://blog.twitter.com/engineering/en_us/topics/infrastruc...

https://blog.twitter.com/engineering/en_us/a/2015/hadoop-fil....

0 comments

therealdrag03y ago

Also Search (the article did says these wouldn’t fit to be fair but the discussion seems to be ignoring how much wouldn’t fit and why). Search is pretty expensive especially since to have it responsive you need the indexes to fit in memory—at least the Lucene variety, which at least in old YouTube videos Twitter used.

marcusae3133y ago

Twitter still uses Lucene. They built a custom codec for it, but doesn't change the cost too much.

j / k navigate · click thread line to collapse

0 comments

therealdrag03y ago

marcusae3133y ago

Twitter still uses Lucene. They built a custom codec for it, but doesn't change the cost too much.

j / k navigate · click thread line to collapse