I don't think the neural remap is that hard - i mean, you can type, and it doesn't work through a pen and text interpretation.

Having used the controllers and leap motion, the controllers I prefer, as grasping nothing is less immersive than grasping a controller - in my view, anyway.

Now, gloves with feedback, those will be interesting - but are a way off.

I was recently thinking about 3d printing trackable objects to get around the whole topic, and allow leap motion/manus/whatever to be that much more real.