I don’t know about “bad”, but any fictional or surrogate reality certainly seems to me like a vice. Whether or not it’s bad depends on if you abuse it too much.
I don't know why you're arguing reality is so great though. Other then us needing to exist in it, there's nothing here to recommend it. Hence caves and then houses.