janas

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models c

What is janas?

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/prabanta-devjanas.svg)](https://yunodb.com/tools/prabanta-devjanas?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/prabanta-devjanas?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/prabanta-devjanas.svg" alt="Featured on YunoDB" height="20"></a>