VR is for gaming. I can see it finding a solid niche there. Make a VR headset that connects to a PC/Mac with extremely low latency and focus all the engineering on the quality of the display and making it lightweight. Gamers will buy it.
AR is IMHO for industrial uses. I could see it being incredibly valuable doing inspections of industrial systems, working in a high-risk environment (for safety awareness), etc. I think the most practical depiction of AR in sci-fi is probably the heads up displays in The Expanse, which make perfect sense to augment human sensory in both military and industrial/maintenance operations in an environment like space.
I actively do not want AR for civilian uses. Yeah, I want to wear glasses and contacts to superimpose ads and slop and Internet drama in front of my life. Get that the hell away from me. When I want to touch grass, I want to touch grass.
A lot of that kind of stuff shows up in cyberpunk, and people forget that most cyberpunk is dystopian. The cyberpunk aesthetic is also kind of 1980s-1990s and is not contemporary. People are stuck in it. We're well past that and even on the tail end of "millennial minimalism" (the Apple aesthetic).
We can imagine HUDs of various sorts with AR glasses that are light and non-obtrusive. But largely well into the future. You may have (probably do have) early adopters who can overlook the manifold limitations that exist today but now you have a tiny audience that isn't enough to drive interesting software development.
I'd buy that in an instant except last time I checked they thought they'd be scanning my face as part of the purchase.
The Palm Pilot (not the first PDA, but an early decent one) pre-dated the iPhone by about 11 years. By that standard, we're likely on the order of a decade away from an "iPhone moment".