Llama.cpp with CUDA Support on Original Jetson Nano (4GB) (opens in new tab)

(github.com)

2 pointsAbishek_Muthian1mo ago2 comments

2 comments

Original title: Llama.cpp with CUDA support on a Jetson Nano

Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.

Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.

j / k navigate · click thread line to collapse

Original title: Llama.cpp with CUDA support on a Jetson Nano

Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.

Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.

j / k navigate · click thread line to collapse