O
omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
What is omlx?
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Keep exploring
View all alternatives Related tools
M
100/100
MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Open source AI
15,848GitHub stars
H
100/100
hyperframes
Write HTML. Render video. Built for agents.
Open source AI
40,274GitHub stars
N
100/100
next-ai-draw-io
A next.js web application that integrates AI capabilities with draw.io diagrams. This app allows you to create, modify, and enhance diagrams through natural lan
Open source AIProductivity
34,483GitHub stars