Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
ingenieroariel
3y ago
0 comments
Save
Share
Try switching all the .cuda() to .mps() I got a 100x speedup on a different language model on a Macbook M1 Air.
https://pytorch.org/docs/stable/notes/mps.html
0 comments
1 comments · 1 top-level
top
newest
oldest
singularity2001
3y ago
dedicated fork:
https://github.com/remixer-dec/llama-mps
j
/
k
navigate · click thread line to collapse