This is less true than it once was. Most of the bug exploits now actually have built-in components that are used instead (observers being the big one).
I don't think that Minecraft is a good choice for actually learning computer engineering, because the physics of Minecraft are very different than real physics. But with modern redstone, I think it could be a really approachable way to understanding the kind of thinking that goes into building a processor.