clawdcursor
clawdcursor compiles whatever's on screen into one UI map — accessibility tree and OCR fused into stable, addressable elements, with a screenshot only when need
What is clawdcursor?
clawdcursor compiles whatever's on screen into one UI map — accessibility tree and OCR fused into stable, addressable elements, with a screenshot only when needed — then drives apps through reusable scripts, verifying every action and routing it through a single safety gate.
Overview of clawdcursor
What it is
Clawd Cursor is a local MCP server that gives any tool-calling agent — Claude Code, Cursor, Windsurf, OpenClaw, the Claude Agent SDK, or your own loop — safe control of the real desktop. It compiles the screen into one UI map: it fuses the accessibility tree and OCR into a confidence-scored set of elements, each tagged with a stable el_NN id, and acts on elements by id — not pixel coordinates. Coordinates appear only in the last-resort screenshot/vision tier. It checks that each action actually did what it claimed. It is local, cross-OS, and works with any model.
Key features
- Compiles the screen into a UI map by fusing accessibility tree and OCR, with stable element IDs (
el_NN). - Acts on elements by ID, not pixel coordinates; screenshot/vision used only as a last resort.
- Verifies its own actions and gates everything through a single safety checkpoint (allow/confirm/block).
- Cross-OS: works on Windows, macOS, and Linux.
- MCP-native: one config, any host (Claude Code, Cursor, Windsurf, etc.).
- Local-only, no cloud required.
- Includes features like pause for user input, clipboard safety, and blind mode for accessibility.
Use cases
- Driving any GUI the way a human would: native apps, the browser, even a canvas.
- Last-mile fallback when a native API or CLI does not exist.
- Automating legacy apps or GUIs with no public surface.
- Safe desktop control for AI agents, with verification and safety gating.
Getting started
See the repository README for installation and quick-start instructions.
License and pricing
License: MIT. Pricing: open source.
Based on the project's public README and repository metadata.