Consumer VR of course involves a disconnect between what you feel and what you see, and that makes people sick when it gets bad enough, but most people can enjoy at least some VR experiences.
By my account, I've managed to spend days of real time within Subnautica exclusively in VR.
If you get sick, what I'd recommend is something like Beat Saber, where you're never moved without physically moving in reality. If that doesn't work something is definitely wrong. The next easiest experience is cockpit simulations. I'd say Subnautica comes somewhere after that, being in the intermediate range.
The worst I've personally tried is Half Life 2 in VR (as in, HL2 just rendering to VR without further changes), and that is indeed not a nice experience because the FPS mechanics just don't work in VR. The acceleration, the need to constantly rotate your view without moving in reality, the need to make very quick and frequent changes in direction are all very hard to tolerate.
> I get the physical games like table tenis and beat saber, but how is this not a fad?
Who cares? What matters if it's fun or not. I enjoy the exercise, I don't do it to fit in. And it's surprisingly good exercise. I lift weights, and Racket NX still is capable of making my arms sore. Then I suppose I have a rather violent play style.