Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 14 additions & 4 deletions docs/cli/features/droid-control.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Droid Control
sidebarTitle: Droid Control
description: Terminal, browser, and desktop automation. Record demos, verify behavior claims, and run QA flows.
keywords: ['droid-control', 'automation', 'demo', 'verify', 'qa-test', 'terminal', 'browser', 'recording', 'video', 'showcase', 'tuistory', 'remotion', 'tctl', 'plugin']
keywords: ['droid-control', 'automation', 'demo', 'verify', 'qa-test', 'terminal', 'browser', 'desktop', 'desktop-control', 'cua-driver', 'computer-use', 'recording', 'video', 'showcase', 'tuistory', 'remotion', 'tctl', 'plugin']
---

Droid Control lets Droids *operate* software: launch apps, type commands, click buttons, record what happens, and produce polished video evidence of it. Built by Droids, for Droids.
Expand Down Expand Up @@ -192,9 +192,9 @@ Every video below was planned, recorded, and rendered entirely by a Droid.

## Automation drivers

Droid Control supports three automation backends. The right one is selected automatically based on what you're targeting.
Droid Control supports four automation backends. The right one is selected automatically based on what you're targeting.

<CardGroup cols={3}>
<CardGroup cols={2}>
<Card title="tuistory" icon="terminal">
**Virtual PTY automation.** Default for terminal work. Playwright-style CLI with asciinema recording and forced truecolor output.
</Card>
Expand All @@ -204,6 +204,9 @@ Droid Control supports three automation backends. The right one is selected auto
<Card title="agent-browser" icon="globe">
**Web and Electron apps.** Playwright-backed CLI with Chrome DevTools Protocol support. Navigates pages, fills forms, clicks buttons, captures screenshots.
</Card>
<Card title="desktop-control" icon="desktop">
**Native desktop apps.** Accessibility-tree snapshots, element or pixel actions, and per-window screenshots via [trycua/cua](https://github.com/trycua/cua) `cua-driver` -- all without stealing focus. macOS and Windows are production tier; Linux is pre-release.
</Card>
</CardGroup>

## Video rendering
Expand Down Expand Up @@ -241,7 +244,7 @@ Demo and showcase videos are rendered with [Remotion](https://www.remotion.dev/)
The plugin uses a composition architecture with three layers:

- **Orchestrator** -- Routes each request through three independent lookups (target, stage, artifact) to determine which skills to load.
- **10 atom skills** -- Self-contained background knowledge loaded on demand, split into drivers, targets, stages, and polish.
- **11 atom skills** -- Self-contained background knowledge loaded on demand, split into drivers, targets, stages, and polish.
- **3 commands** -- Parse arguments into commitments, then delegate to atoms via hybrid handoffs.

Every workflow flows through **capture → compose → verify**. Commands declare *what* to produce; atoms own *how*. Skills chain through explicit handoffs rather than hardcoded pipelines, so the droid follows the flow naturally.
Expand All @@ -268,6 +271,13 @@ Only install what you need for your use case.
agent-browser install # downloads Chromium
```
</Accordion>
<Accordion title="Native desktop apps (desktop-control)">
```bash
curl -fsSL https://raw.githubusercontent.com/trycua/cua/main/libs/cua-driver/scripts/install.sh | bash
Comment thread
factory-ain3sh marked this conversation as resolved.
cua-driver skills install # upstream skill pack (deep tool reference)
```
Windows installs via PowerShell: `irm https://raw.githubusercontent.com/trycua/cua/main/libs/cua-driver/scripts/install.ps1 | iex`. macOS additionally needs `cua-driver permissions grant` (Accessibility + Screen Recording).
</Accordion>
<Accordion title="Real terminal emulator (true-input)">
| Platform | Required tools |
|----------|----------------|
Expand Down
Loading