jitllm
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
What is jitllm?
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs