it's quite likely that your issue is with the actual node_modules directory being referenced as part of your source. It slows the LSP too.
Exclude it (via https://code.visualstudio.com/docs/getstarted/settings) by using
"files.exclude": {
"**/.git": true,
"**/.svn": true,
"**/.hg": true,
"**/CVS": true,
"**/.DS_Store": true,
"**/Thumbs.db": true,
"**/node_modules" : true
}
I've not had any issues with speed ever since i started excluding directories that contain junk stuff that you know you will not ever need to see in a project's view.