vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Compare with this toolExplore highly rated tools in the same categories as AI-Novel-Writing-Assistant, compared using public project data.
12 tools
A high-throughput and memory-efficient inference and serving engine for LLMs
Compare with this toolJan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Compare with this toolSearch infrastructure for AI
Compare with this toolVisualizer for neural network, deep learning and machine learning models
Compare with this toolUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Compare with this toolGenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashb
Compare with this toolBuild and run agents you can see, understand and trust.
Compare with this toolMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Compare with this toolThe local UI to run and train text and diffusion models, including Kimi K3, Gemma 4, Qwen3.6, DeepSeek-V4, FLUX and more.
Compare with this tool🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.
Compare with this tool⛰️A General Hill-climbing AI harness that helps you move from Current State to Ideal State in both Life and Work.
Compare with this tool📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
Compare with this tool