xinfer
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
What is xinfer?
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.