clawdcursor

clawdcursor compiles whatever's on screen into one UI map — accessibility tree and OCR fused into stable, addressable elements, with a screenshot only when need

What is clawdcursor?

clawdcursor compiles whatever's on screen into one UI map — accessibility tree and OCR fused into stable, addressable elements, with a screenshot only when needed — then drives apps through reusable scripts, verifying every action and routing it through a single safety gate.

Overview of clawdcursor

What it is

Clawd Cursor is a local MCP server that gives any tool-calling agent — Claude Code, Cursor, Windsurf, OpenClaw, the Claude Agent SDK, or your own loop — safe control of the real desktop. It compiles the screen into one UI map: it fuses the accessibility tree and OCR into a confidence-scored set of elements, each tagged with a stable el_NN id, and acts on elements by id — not pixel coordinates. Coordinates appear only in the last-resort screenshot/vision tier. It checks that each action actually did what it claimed. It is local, cross-OS, and works with any model.

Key features

  • Compiles the screen into a UI map by fusing accessibility tree and OCR, with stable element IDs (el_NN).
  • Acts on elements by ID, not pixel coordinates; screenshot/vision used only as a last resort.
  • Verifies its own actions and gates everything through a single safety checkpoint (allow/confirm/block).
  • Cross-OS: works on Windows, macOS, and Linux.
  • MCP-native: one config, any host (Claude Code, Cursor, Windsurf, etc.).
  • Local-only, no cloud required.
  • Includes features like pause for user input, clipboard safety, and blind mode for accessibility.

Use cases

  • Driving any GUI the way a human would: native apps, the browser, even a canvas.
  • Last-mile fallback when a native API or CLI does not exist.
  • Automating legacy apps or GUIs with no public surface.
  • Safe desktop control for AI agents, with verification and safety gating.

Getting started

See the repository README for installation and quick-start instructions.

License and pricing

License: MIT. Pricing: open source.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/amrdabclawdcursor.svg)](https://yunodb.com/tools/amrdabclawdcursor?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/amrdabclawdcursor?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/amrdabclawdcursor.svg" alt="Featured on YunoDB" height="20"></a>