Yes I agree, I forgot about dev containers.
If I am doing ML most of the time I am using a server GPU with a large dataset. This is one of the use cases that made me use VSCode more than RStudio.
When I have really wanted to use RStudio I use the web version, but its less pleasant than a simple ssh remote.