Funny, on my gaming windows computer I turn off my OLED monitor BEFORE I turn off the computer to let it do its special processing reliably. I’ve had the opposite issue to yours, several windows will remain on the turned off monitor! I have that one on HDMI and the second monitor on a DP connection.
