AFAIR, it was a stock Motorola DSP. The only that was odd about it was that it was mounted on the motherboard. You could (and I did) get access that sort of DSP through daughterboards before the Cube, but NeXT took the step of saying "this ought to be a part of the computer itself".
I really disagree about it as a direct ancestor of the contemporary plugin API. These have always run on the host CPU, not dedicated DSP chips (excluding of course Digidesign's original ProTools model, but that was DSP farm rather than just a chip).
And the sort of DSP that was being done on the Cube DSP was being done before the Cube too.