jitllm

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM

What is jitllm?

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM