Using current pre-fab techniques a half dozen builders can raise the core structure of a single family house in a few days. A friend of mine is in the process of building a house and raising the core structure was the fastest and easiest part of the whole process. I don't see this being either cheaper or faster.
The bulk of the cost in many cases is things independent of the actual house, like purchasing the land, doing the ground work and the foundations and pulling in water and sewage.