undefined | Better HN

0 pointsmanigandham9y ago0 comments

While 1k/sec seems to be an average throughput for most web apps due to all the logic, 10k/sec is nowhere near the limit for fast systems, many can do well into 6 figures per second with some now doing millions/sec.

0 comments

3 comments · 1 top-level

user59944619y ago· 2 in thread

Right. 10k is not a hard limit. It's the standard I expect, for real world applications, on classic server hardware, with limited tweaking.

The 6 figures benchmarks that send/receive 1 byte data with all unsafe flags enabled are not representative of real usage.

manigandhamOP9y ago

Your description for fast systems refers to high-performance software like load balancers and databases. In this case, 10k is nowhere near the limit on modern machines, they all do 6 figures per second.

user59944619y ago

With good hardware and good tuning, possibly. Again I'm not saying it's a hard limit, I'm saying it's a reasonable expectation for real world production usage ;)

At 100k requests/s on a load balancer. The HTTP headers alone (450 bytes) with zero content are more than 1300 MBps of traffic. And well, the CPU will bottleneck long before that amount of requests to parse.

j / k navigate · click thread line to collapse