But in the end, because of nature of things, slugish frontend has bigger affect on user's experience then slugish backend.

Overly complicated, architecture-astronaut code, that leans on frameworks for no good reason, is bad, no matter what part of the stack. And yes, this is true for the backend as well. There are people who will happily import 3 different frameworks to make a POST request in Go.