I also use neo2 and am using the neo arrow keys and Esc on layer 4. Works like a charm.

Fun thing with neo: You have additional keys free for keybindings: hjkläöüß

I'm using ä, ö and ü to save, close buffer and quit vim. I'm very happy with that.