But you also have a pretty powerful card, unless you're gaming in 4K you could probably take a performance hit and not even notice.
I have a 3060 (prev: 1660 ti) and I can say that I've definitely noticed a difference in performance in lots of games.