OpenDesk
vitalops
Give any AI agent eyes and hands on one or more desktops via computer-use tools.
What is OpenDesk?
An MIT-licensed computer-use framework that lets agents control real machines: screenshot capture with element marking, selector-free UI interaction, mouse/keyboard control, and OCR, plus task recording/replay, scheduling, and remote control of other machines over an encrypted WebSocket. It ships both Python (opendesk on PyPI) and JS/TS (@vitalops/opendesk-sdk) packages and integrates with MCP, Claude Code, OpenAI, and LangChain.
Pros & Cons
Pros
- Healthiest signals of the batch for its age: MIT across the codebase, ~5:1 fork-to-star ratio, and both Python and JS/TS SDKs
- Multi-machine control over an encrypted WebSocket, plus recording/replay and scheduling - more than a single-box demo
- Framework-agnostic integrations (MCP, Claude Code, OpenAI, LangChain) rather than lock-in to one agent stack
Cons
- Development has been quiet since early June 2026 (last push 2 June), so momentum is unclear despite the mature-looking feature list
- Encryption for remote control is claimed but there is no independent security review of a tool that drives a real desktop
- Granting an early-stage agent full mouse/keyboard control of your machine has an obvious blast radius if the model misbehaves
License
MIT (OSI-open)
When it is interesting
You need agents to drive real desktop apps (local or remote) across macOS, Linux, and Windows from your existing framework.
When it is too early
You are not comfortable granting an early-stage tool full control of a machine, or you need audited security guarantees.
This repo featured in the 2026-07 edition of the Open-Source AI Radar.
UI-TARS-desktop
bytedance
Native desktop app for a GUI/computer-use agent powered by the open-weight UI-TARS model.
strix
usestrix
Framework of autonomous AI hacker agents for dynamic application security testing.
Page Agent
alibaba
In-page JavaScript GUI agent - control any webpage with natural language, no headless browser or extension.