The problem with this is, the "factory owners" of the world run a political machine which they use to prevent that from happening, claiming it prevents them from building more factories. They use the same political machine to establish the moral goodness of continued factory building as axiomatic.
This makes everything rather complicated.