Hey you may not get this reply till much later but I'd love more info.
From my research in the last couple days, it only seems that PyTorch will work with AMD cards in combo with RocM, and RocM specifically isn't supporting older AMD gpus that you find on Mac laptops from just 2020.
MPS is Metal Performance Shaders which is Apple's MacOS libraries for ML workloads. The MPS libraries are only on MacOS, but support both Apple Silicon and AMD GPUs. This means that on MacOS, you specify the 'mps' backend to pytorch as the device instead of 'cuda' or 'cpu', and MacOS runs operations on whatever GPU is available, be it an M1 or an M2 or an AMD GPU.