I'd contest that second point. I'm actually one of those people that builds the parts that make accelerators (accelerator physics PhD student). There's a lot more interesting accelerator tech outside of the energy frontier.
My specific interests for instance are how we can build university scale light and matter sources for atomic physics. It requires the same types of advances that will power future colliders, but enables different types of research.