For me it seems like (haven't measured) being only on the keyboard or only on the mouse is faster than trying to switch between the two, if only because I avoid the mental context switching.
I get terrible wrist pain when I even look at a mouse so editing speed is a secondary concern for me.