No need to rebuild everything. Simply having the "DLLs" or equivalent checked in or in a maven/NuGet folder backed up would do the trick.
Your not just saving developer downtime. Remember that non incident a few months ago? Could be a security issue too.