To me the most intrusive thing is to change things in my environment. Font size for example will change how lines wrap and scroll position. The color will mess with syntax highlighting. Etc.

Something not intrusive will not change my editor but something not important for that type of work. It doesn't mean its not distracting, it should be for this kind of thing.

Mouse movements are defenitelly intrusive in classic IDE, I don't use mouse in vscode.