maid
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remote
What is maid?
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
Overview of maid
What it is
Maid is a free and open source application for interfacing with llama.cpp models locally, and with API Route, Anthropic, DaoXE, DeepSeek, Mistral, Novita, Ollama, llmman, OrcaRouter, LiteLLM, Opper and OpenAI models remotely. It is built using React Native and is available for Android. The application is designed to be fast, efficient and user-friendly.
Key features
- Local inference: run GGUF models fully on-device via llama.cpp; no internet required - Remote providers: connect to multiple remote providers with your own API key, or to a self-hosted LiteLLM proxy for 100+ providers behind one endpoint - One-tap model downloads: browse and download curated Hugging Face models (Qwen, Phi, LFM, TinyLlama, and more) directly from the app - Bring your own model: load any GGUF file from local storage - Conversation management: create, rename, delete, export, and import chats as JSON - Customisable parameters: tune temperature, top-p, top-k, context length, and other generation parameters per session - Custom system prompt: set a global system prompt and assistant persona - Voice output: pair with Maise for text-to-speech - Material You theming: light and dark themes that follow your system preference - Fully open source: MIT licensed, no telemetry, no ads
Use cases
Running large language models locally on an Android device without internet access. Connecting to various remote AI providers (Anthropic, OpenAI, etc.) through a single interface. Experimenting with different GGUF models by downloading them directly or loading custom files. Managing multiple conversations with adjustable generation parameters.
Getting started
Clone the repository: bash git clone https://github.com/Mobile-Artificial-Intelligence/maid.git Install dependencies: bash yarn install For building the Android APK: bash yarn build-android The output APK will be located in the android/app/build/outputs/apk/release directory.
License and pricing
This project is licensed under the MIT License. Maid is free and open source. No pricing information is provided for the application itself; remote providers may require their own API keys and associated costs.
Based on the project's public README and repository metadata.