In a VR headset the virtual screen distance is set by the distance of the microdisplay from the lens in the headset.
It's not crazy to think you could move the microdisplay position and get a virtual display at 6". There might be other optical consequences (aberrations, change in viewable area) but in principle it can work.