This is why I have to run 2 GPUs on my work laptop. My 6 monitors are split 3/3 between the iGPU and the dGPU. Except the drivers are all trash so any time a monitor connects or disconnects there's about a 90% chance the displays stop updating and forces either a reboot or a restart of something up the software chain. What would be really nice is to find a way to keep my programs running some restarting the GPU drivers, which Windows can often do.
I'll also note that I haven't had success with just more physical adapters. The drivers complain they can't create a CRTC for them.