I built llama3.java in the past, this is a follow-up: Gemma 4 running entirely on the JVM.
No Python. No JNI. No native code. Just Java.
It’s (mostly) a single Java file implementing the full stack:
GGUF parsing, tokenization, Gemma 4 transformer inference, quantizations, CLI...
Built using the Java Vector API, with support for GraalVM Native Image.
