PocketLLM

Inference engine for large language models on consumer GPUs, with deep optimization for older hardware

What is PocketLLM?

Inference engine for large language models on consumer GPUs, with deep optimization for older hardware

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/lvyufengpocketllm.svg)](https://yunodb.com/tools/lvyufengpocketllm?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/lvyufengpocketllm?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/lvyufengpocketllm.svg" alt="Featured on YunoDB" height="20"></a>