dgx-spark-inference-stack

Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and

What is dgx-spark-inference-stack?

Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich people. Updated once a month. Hobby project

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/jdalndgx-spark-inference-stack.svg)](https://yunodb.com/tools/jdalndgx-spark-inference-stack?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/jdalndgx-spark-inference-stack?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/jdalndgx-spark-inference-stack.svg" alt="Featured on YunoDB" height="20"></a>