Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon
Best LLM Chat Tools
LLM chat tools are the front door to modern AI — from general assistants to specialist chat UIs. Scan popular GitHub projects here (ranked by stars), then open the compare page for a compact decision table.
Popular on GitHub (by stars)
4,299 projects · ranked by GitHub stars, not a quality score
Eight-platform full-stack AI operating system - unifies 176 LLMs via LangGraph + MCP + A2A. Multi-tenant RLS over 340 tables, RAG knowledge...
RondoFlow is a local-first, open-source platform for visually orchestrating Claude Code AI agents. Use a drag-and-drop canvas to create agen...
The open-source workspace for coding agents. supermux runs Claude Code, Codex, and other coding agents on your own computer or server, many...
AIHelper is a lightweight tool that seamlessly integrates web‑based large language models (such as ChatGPT) into your work, entertainment, a...
A language model trained from scratch and running offline on an ESP32-S3 with a touchscreen chat interface.
A command-line interface for Garmin Connect - activities, health, workouts, devices, and more - with JSON output, secure credential storage,...
Agent Skill that turns plain-English scene descriptions into AI-generated 3D models built live in Blender, via Alpha3D + Blender MCP. Works...
Obsidian-backed project memory for Claude Code and Codex.
Text-first toolkit for building reproducible, composable LLM workflows as plain files in OCaml.
PyTorch-equivalent deep learning framework in pure Rust — 22 crates, CUDA GPU, vision, LLMs, ONNX, autograd, distributed training
Real-time AI object recognition from your phone camera — NVIDIA vision LLM behind a Cloudflare Worker proxy, cyberpunk UI.
Mindlas catches your coding agent drifting before the bad code lands. Real-time tracking and correction for context rot, unverified done cla...
Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
R package to easily construct prompts and associated logic for interacting with large language models (‘LLMs’)
AI brain for your Paperless-ngx archive — chat with your documents via local (Ollama) or cloud LLMs, with agentic tool use, semantic search...
FastAPI backend blueprint for AI agent apps: DDD, SQLAlchemy, Taskiq, admin UI, RAG infra, and Claude/Codex collaboration harness.
Ubiq-Genie is an open-source framework for integrating AI capabilities into social VR platforms. It offers a modular approach for server-ass...
[EMNLP'25 main] This is the official repo for the paper, Can LLMs be Good Graph Judge for Knowledge Graph Construction?
Invisible, key-verifiable watermarks for AI/LLM-generated text — SynthID-Text-style, in Rust + WebAssembly (Node + browser). Live playground...
AI-native software delivery workflow for Claude Code and Codex: design, change, implement, test, review, and archive.
Store, query, and create YAML workflow playbooks for LLM agents via MCP. STDIO or Streamable HTTP.
Typed structured extraction from PDFs, photos & text via any LLM — Instructor for Swift, document-first
Claude Skills for Ableton Live producers. Workflows for Claude Code, Cursor, Codex, and Gemini CLI. Pairs with any Ableton MCP server. MIT.