undefined | Better HN

0 pointsliuliu2y ago0 comments

mmap weights directly from a file seems to be new (I think). Need to check notes to remember whether you can already do that with some cuda* API.

0 comments

aseipp2y ago

Yeah, I think a good simple litmus test for this is "can I directly call mmap(2) on a file, and then launch a kernel on that mmap'd memory, with no extra steps, and it works as I expect it to". With these newer features in CUDA, the answer to that is "yes you can."

j / k navigate · click thread line to collapse

0 pointsliuliu2y ago0 comments

mmap weights directly from a file seems to be new (I think). Need to check notes to remember whether you can already do that with some cuda* API.

0 comments

aseipp2y ago

j / k navigate · click thread line to collapse