mobile-use

AI agents can now use real Android and iOS apps, just like a human.

What is mobile-use?

AI agents can now use real Android and iOS apps, just like a human.

Overview of mobile-use

What it is

Mobile-use is an open-source AI agent that controls Android or iOS devices using natural language. It interprets commands and interacts with the user interface to perform tasks such as sending messages or navigating apps.

Key features

  • Natural Language Control: Users can interact with their phone using their native language.
  • UI-Aware Automation: The agent navigates app interfaces intelligently, though it has limited effectiveness with games because they do not provide accessibility tree data.
  • Data Scraping: It can extract information from any app and structure it into a desired format (e.g., JSON) using a natural language description.
  • Extensible and Customizable: Supports different LLMs including OpenAI, Google, xAI, OpenRouter, MiniMax, and others.

Use cases

  • Automating routine tasks on mobile devices, such as checking battery level or finding unread emails.
  • Extracting structured data from apps for analysis or reporting.
  • Testing and interacting with app UIs programmatically.

Getting started

To run locally, copy the environment file and optionally customize the LLM configuration. For a quick Docker launch on Android, use the provided shell script. Manual installation requires cloning the repository, setting up a virtual environment with uv, and installing dependencies. bash cp .env.example .env # Optional: cp llm-config.override.template.jsonc llm-config.override.jsonc # For Docker quick launch (Linux/macOS): chmod +x mobile-use.sh bash ./mobile-use.sh 'Open Gmail, find first 3 unread emails, and list their sender and subject line' --output-description 'A JSON list of objects, each with 'sender' and 'subject' keys' # For manual launch: git clone https://github.com/minitap-ai/mobile-use.git && cd mobile-use uv venv source .venv/bin/activate uv sync python ./minitap/mobile_use/main.py 'Go to settings and tell me my current battery level'

License and pricing

The project is licensed under Apache-2.0 and is open source.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/minitap-aimobile-use.svg)](https://yunodb.com/tools/minitap-aimobile-use?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/minitap-aimobile-use?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/minitap-aimobile-use.svg" alt="Featured on YunoDB" height="20"></a>