It would conceivably be possible to have a lot of physical states. That doesn't mean that they are actually possible from our current state and rewrite rules. So it's not actually a given that it can be built just because it's physical.
Your very idea is also predicated on the idea that it's possible for a real object to exist that isn't physical, and I think most modern philosophers reject the idea of a spiritual particle.
