LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Open sourceAI
S
100/100
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Open sourceAI
P
100/100
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete pr