I struggle to find good resources on this topic. The few I found indeed attribute the lower latency of more recent Wi-Fi generations to techniques like MLA and OFDMA, not necessarily the frequency (which makes sense, of course). The cudy link makes it look like channel congestion is a factor, too.
https://www.rtings.com/router/learn/research/wireless-latenc...
https://www.zbtwifi.com/blogs/frontier-technology-news/wi-fi...
https://www.cudy.com/en-benelux/blogs/news/6-ghz-vs-5-ghz-th...