Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
jeffreyq
1mo ago
0 comments
Save
Share
https://blog.railway.com/p/incident-report-february-11-2026
0 comments
3 comments · 1 top-level
top
newest
oldest
x0x0
1mo ago
· 2 in thread
"we did not have the monitoring or controls to prevent our anti-fraud from hard killing 3% of workloads, including many instances of pg"
Oof.
rzmmm
1mo ago
Needs an anti-anti-fraud service which terminates malfunctioning anti-fraud services.
x0x0
1mo ago
When I've written similar services, there was a (low) hard cap on how many fraud decisions they could action before they quit and paged. If we were getting hit with a wave of something, a human had to temporarily bump that limit.
j
/
k
navigate · click thread line to collapse