Dex

A calm cockpit for commanding agents you can trust.

Dex is a Windows-first, chat-first control surface for a local AI agent that has hands on your machine — it can drive real Windows app GUIs (Office, browsers, settings panels, anything with a UI) by reasoning about what you asked for and previewing every action before it runs.

> v1 is desktop Windows only. Mobile, macOS, and Linux are in the roadmap but not built. See prompt.md §9 for the scope boundary.

---

Architecture

Flutter app (Dex)
   │  HTTP + WebSocket on 127.0.0.1:18789
   ▼
Dex gateway (Node 24)                       ← the brain · Anthropic Claude
   │  MCP stdio (picks per-turn based on SKILL.md descriptions)
   ▼
   ┌───────────────────────────┬─────────────────────────────┐
   ▼                           ▼                             ▼
Dex built-in            windows-desktop-              browser-control
shell / file / process  control MCP (UFO²)            MCP (browser-use)
                        Python 3.10/3.11              Python 3.11
                        Win32 UIA, Groq Qwen 3        Playwright + Groq Qwen 3
                        run_desktop_task              run_browser_task

• Dex core (dex/core/) — sessions, channels, skills, memory, cron, built-in shell tools. Forked from OpenClaw at commit 7074cf8e23c1f64362c4f8c4bf32971ca94d5221 (see dex/core/HERITAGE.md for the heritage commitment); the user-facing binary is dex and the npm package name is dexagent.
• UFO² (vendor/UFO/) — Windows native-app GUI automation via the accessibility tree.
• browser-use (vendor/browser-use/) — browser automation via Playwright + an LLM-driven agent.
• windows-desktop-control (dex/drivers/windows-desktop-control/) — MCP server exposing run_desktop_task to Claude.
• browser-control (dex/drivers/browser-control/) — MCP server exposing run_browser_task to Claude.
• app/ — the Flutter client. Talks to the Dex gateway. Implements design.md; renders Gemini-style tool chips so the user sees which tool Claude picked.

---

Quick start

> See PLAN.md for the full phased build plan and current progress.

# 1. one-time prereq check
.\scripts\setup-windows.ps1

# 2. when all phases are done
.\scripts\run-dev.ps1   # starts gateway + MCP server + Flutter app

Requirements:

• Windows 10 / 11
• Node 24 (or Node 22.19+)
• Python 3.10
• Flutter SDK with Windows desktop target enabled
• Anthropic API key (OpenClaw)
• Groq API key (UFO² default — Qwen 3, free)

---

Repo layout

D:\project1\
├── README.md                  this file
├── PLAN.md                    live progress tracker — read this first when resuming
├── LICENSES.md                third-party license audit
├── SECURITY.md                risk surface + isolation
├── design.md                  UI/UX spec — single source of design truth
├── prompt.md                  build contract — assistant rules of engagement
├── dex/                       Dex framework (Phase B.9+)
│   ├── core/                  forked OpenClaw runtime + dex binary
│   │   ├── HERITAGE.md        origin commit + MIT credit
│   │   ├── package.json       "name": "dexagent", "bin": { "dex": ... }
│   │   ├── src/               TS source (post-rebrand: Dex / DEX_*)
│   │   └── packages/          @dexagent/* workspace packages
│   └── drivers/               MCP driver servers (Python 3.10/3.11)
│       ├── windows-desktop-control/  FastMCP wrapper around UFO²
│       └── browser-control/   FastMCP wrapper around browser-use
├── vendor/
│   ├── UFO/                   pinned commit, do not modify
│   └── browser-use/           pinned commit, do not modify
├── docs/migration/            B.1 audit + B.11 migration report
├── app/                       Flutter desktop client (com.chethan616.dex)
└── scripts/                   PowerShell helpers (rebrand / audit / run-dev)

---

Pinned vendor commits

Recorded so builds are reproducible. Update only when intentionally bumping.

| Vendor | Commit | Date pinned | |---|---|---| | core/ (Dex brain — fork of openclaw/openclaw) | 7074cf8e23c1f64362c4f8c4bf32971ca94d5221 | 2026-06-03 — see core/HERITAGE.md | | microsoft/UFO | adef15b8789b015356977ed742916de2da644509 | 2026-05-26 | | browser-use/browser-use | 4931a7e0217cf9c64450348b96511733263c9268 | 2026-06-01 |

---

License

Dex source in this repo is MIT. See LICENSES.md for the full third-party audit (vendored repos, Flutter deps, fonts). No AGPL components are bundled with the shipped product.