You still have Article III remedies in that case.
If the extreme version of non-delegation took hold, it would be the end of all rational regulation. Do you REALLY want Congress writing technical documents about effective isotropic radiated power? Or the shape of curb ramps?