For me, I like the professional pipeline and stunning visuals of Unreal, but would not recommend it to anyone not doing this full time with a team. Unity I think is more accessible and can easily be made to look great as well, and is well suited for small teams or single developers.
Specifically relating to VR, I have worked and made full projects in both, and I prefer Unity and would highly recommend it over Unreal for VR, but you should try both and see what feels more intuitive for you.