Open Computer Use
open-computer-use
An open MCP server for desktop control: the agent reads app state and clicks, types and scrolls on macOS, Linux and Windows
High risk
We rate an entry high when the tool writes to external systems, handles money, production databases or secrets, or runs arbitrary commands. The CLI installs it only with your consent.
Why this level
- Drives the real desktop session: clicks, types and can change data in apps
- Requires Accessibility and Screen Recording permissions
Install
Manual install
npm i -g open-computer-useInstalls the server and CLI globally, short alias ocu. On macOS run once and grant Accessibility and Screen Recording.
This is third-party code. Review the repository files before installing.
What it does
The project wraps computer control in a local MCP server and CLI that any agent can connect to. Through the operating system accessibility layer it captures a semantic tree of an app's interface and acts on elements rather than only on coordinates. The tool surface is the same on every platform: list apps, get app state, click, secondary action, scroll, drag, type text, press key and set value. It ships install commands for Codex, Claude Code, Gemini CLI and opencode, plus a manual JSON config fragment. On macOS it needs version 14.0 or later and Accessibility and Screen Recording permissions.
Who it is for. For developers and QA engineers who need an agent to drive desktop apps directly.
Good fit when
- You need the agent to click and type in ordinary desktop apps
- You need computer use locally, without a cloud provider
- You need one control tool surface across macOS, Linux and Windows
Not a fit when
- The task is solved by browser automation rather than full desktop control
- macOS is older than 14.0, where the runtime does not launch
- You cannot give the agent access to a live desktop session
Example request
Open TextEdit, create a new document and type my note into itLimitations
The server drives the user's real desktop session, so it acts like a person at the machine. macOS needs version 14.0 or later plus Accessibility and Screen Recording permissions. On macOS a drag does not run a window-server drag session unless OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS is enabled. A model for the agent must be connected separately; it is not part of the project.
How to disable. Remove the open-computer-use block from your agent's MCP config and uninstall the global package: npm rm -g open-computer-use.
MCP
- Transport
- stdio
- Authentication
- not required
| Environment variables | |
|---|---|
| OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS | Enables global pointer fallbacks on macOS, including window-server drag sessions. It may move the real pointer, so enable it only when needed. |
Security check
- Drives the real desktop session: clicks, types and can change data in apps
- Requires Accessibility and Screen Recording permissions
README in short
The README presents open-computer-use as an open alternative to Codex Computer Use wrapped as MCP. It installs globally via npm, with ocu as a short command alias. It offers install commands for Codex, Claude Code, Gemini CLI and opencode, a manual JSON config fragment and a skill install via npx skills. It shows examples of calling individual tools and sequences through the CLI, plus a doctor command to check permissions. MIT licensed.
FAQ
Which systems are supported?
macOS 14.0 and later, Linux and Windows. Each platform has its own runtime, but the tool surface is identical.
Is a cloud service required?
No. The server is local and runs on your machine. You connect the agent's model provider yourself.
Related
An MCP server with n8n node and template knowledge: the agent picks nodes, validates configs and, with API access, creates workflows in your n8n
Zapier's official MCP plugin: the agent gets actions across thousands of apps through your Zapier account
Awesome Claude Skills by Composio
Awesome Claude Skills
A curated list of Claude skills and plugins, plus Composio's own automation skills for 78 SaaS apps
A plugin and CLI catalog for agents: generates command-line interfaces for GUI apps like GIMP and Blender and installs ready ones via CLI-Hub