I'd rather risk that every tenth contract is fraudulent than have every contract cost twice as much with the government doing it themselves. There's just zero incentive for government employees to work quickly and efficiently.
Check private contractor's work to make sure they're not cutting any corners, make corruption harder and incentivize whistle-blowers, but letting the government do things is not something I want as a taxpayer.