glm-5.2-in-c

GLM-5.2, a 744 billion parameter mixture of experts model, in a pure C inference engine: quantized to int4, experts streamed from disk, deployed and benchmarked

What is glm-5.2-in-c?

GLM-5.2, a 744 billion parameter mixture of experts model, in a pure C inference engine: quantized to int4, experts streamed from disk, deployed and benchmarked. Generates in 16 GB of RAM.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/fareedkhan-devglm-52-in-c.svg)](https://yunodb.com/tools/fareedkhan-devglm-52-in-c?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/fareedkhan-devglm-52-in-c?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/fareedkhan-devglm-52-in-c.svg" alt="Featured on YunoDB" height="20"></a>