Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
ingenieroariel
3y ago
0 comments
Share
Try switching all the .cuda() to .mps() I got a 100x speedup on a different language model on a Macbook M1 Air.
https://pytorch.org/docs/stable/notes/mps.html
0 comments
default
newest
oldest
singularity2001
3y ago
dedicated fork:
https://github.com/remixer-dec/llama-mps
j
/
k
navigate · click thread line to collapse