Several ways of doing this without relying on k8s

> observability

This doesn't require k8s neither and it's more on your app. Systemd can restart systems by itself

> how do you update that stack without bringing down everything

That's probably where redundancy helps the most. I wouldn't run a big service without it (but again it found be at server level)