chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

What is chitu?

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.