That's what you might expect, but it requires another breakthrough IMO. From what I understand of LLMs, they can't be incrementally improved to add logical reasoning since they're just guessing the next word. It's impressive and fine in many cases, but there are many where it's not enough.
They already have some form of reasoning though. GPT4 can solve novel problems. It's certainly not incredible at it, but the incremental logical reasoning improvements have already begun.