Hard drives are named that way because they are devices that spin (drive) solid disks. Similarly a floppy drive is the device spinning the floppy.
You could argue that the solid state drive "drives" things in the sense of "control", or analogous to how a microcontroller drives its pins. But more likely it's named that way because "drive" has become synonymous with storage, as in "C-Drive".