One of the things that has caught me is syntax checking. I use the syntastic plugin, set to check syntax on write, and I apparently save my changes pretty frequently. Some files can take 2-3 seconds to run an external syntax checker, during which time I can't edit the file.
I guess the real problem is me saving too often. Others may be trying to run a long make from vim and wanting to continue editing or looking through files.