There is nothing wrong in the muscle memory point, but the key point is different. Whether you DISTRACT or NOT DISTRACT from your lines of code? Do you spend some extra energy for returning your view to your line of code or not spend? Are you able to free your visual stream into your brain from seing keyboard or not able?
Look at Vim workflow, one of the most popular editor for programmers, its command mode seems absolutely pesky for those who not touchtypes.