xllama
Local LLM inference on Xbox Series S and Series X in Developer Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, an OpenAI-compatible LAN endpoint (off by default),
What is xllama?
Local LLM inference on Xbox Series S and Series X in Developer Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, an OpenAI-compatible LAN endpoint (off by default), SD-Turbo image generation and experimental on-device fine-tuning. Measured on Series S. Independent project, not affiliated with Microsoft.