My brain contains loads of copyrighted info. And if I exactly reproduce it from memory, it's copyright infringement. But if I come up with my own work, even if using that copyrighted info to learn from, it isn't infringement.

Yes. Courts will generally assign blame to whoever did the thing that caused a breach of the law, which in this case is the user.

In other words, law isn’t a programming language.