I discussed the difference earlier: https://news.ycombinator.com/item?id=38255476
Quantum mechanics is used in very different ways by people in quantum information, condensed matter, many body physics, quantum field theory, nuclear physics and may other (sub)fields.
Of course it will be difficult for a quantum information theorist if they try to apply what they know directly to a hydrogen atom, but (speaking from experience) it will also be quite difficult for someone trained in what you call Hermitian quantum mechanics to directly apply what they know to quantum field theory, or quantum information or any other subfield that uses different language.
I strongly disagree with your summary "if you know Hermitian quantum mechanics then unitary quantum mechanics is conceptually straightforward. If you know unitary quantum mechanics then you will have a lot of new concepts and mathematics to learn before you understand hermitian quantum mechanics".
I challenge anyone trained in Hermitian quantum mechanics to make progress on (for example) proving or disproving the generalised quantum Stein's lemma, or any of the unsolved problems here https://arxiv.org/abs/2002.03233 using those methods.
For example, the paper you cite is entirely understandable for anyone with some training in hermitian QM. In contrast, good luck trying to understand elementary concepts like the spectrum of the hydrogen atom or interference of matter waves from unitary QM.
Of course the field of quantum info has progressed enormously and has its own interesting challenges, for which hermitian QM is all but useless.
Concepts like the spectrum of the hydrogen atom or interference phenomena aren't particularly difficult to understand conceptually: the Hamiltonian has some eigenvectors and eigenvalues, you use the Dirac equation and work them out. The "matter waves" interfere essentially in the same way that waves on the surface of a pond do.
The things that you're calling conceptual understanding I guess must be different to this: maybe something like detailed calculations of the structure of the spectrum?
For a pure mathematician, quantum mechanics is a lovely introduction to Hilbert Spaces.
I know there are what are called C*-algebras, which help solve some of these issues, but I don't know anything about them. I do know that the Hilbert Space approach is not sufficient.