If you don't have any background in a topic, then how do you know it is getting it right? You don't know enough to know if you can trust any given response. Either you have to independently verify what it says with trusted sources, or you just throw your hands up and accept that you're getting taught by the digital equivalent of a once-brilliant professor who did too many hits of LSD.
Valid point, however, I personally believe that the questions generated hold greater significance as they provide direction in terms of what to explore in a particular subject —something that GPT by itself does not provide as it needs to be prompted first—