AMD has legitimately been making great progress. They still have a long way to go, and I appreciate SemiAnalysis taking up the mantle of calling them out, but I ran:
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm6.3
today on stream and it just worked. No external ROCm install, and just the amdgpu driver that's in Arch.
We also have our own complete driver/runtime now in tinygrad; it's so much nicer to build on a foundation when you can blame yourself for the bugs.