GPT4 + a RLHF that was trained to think it was human would be a much different beast.
Imagine you take a human and train them to be an AI assistant since they were a baby. I imagine their behaviour would also be very odd compared to average people.