Compared to other areas, I'd say "negligible" - but I wasn't involved personally (only joined the team later on), so take it with a grain of salt as it's not impossible that I'm missing something.
The M4 core was already there in the SoC sitting unused, it's not like it was added just for firmware loading ;)