Accio Cu

Accio Computer Use

Hybrid computer use for AI agents.

GUI actions, CLIs, APIs, and files—combined in one Python block.

[](LICENSE) [](VERSION)

[Quick start](#quick-start) · [Security](#security) · [Results](#macosworld-results) · [Citation](#citation) · [Contributing](CONTRIBUTING.md)

---

Accio brings macOS interaction into normal Python, so an agent can use the GUI only where the GUI is needed and combine it with shell commands, app CLIs, APIs, and files in the same task.

• Hybrid by default. Desktop actions and ordinary code share one execution block, including imports, conditions, loops, parsing, and local tools.
• Fewer model round trips. A block can complete dependent steps, branch on returned state, and recover locally instead of asking the model to plan every click separately.
• Observable and verifiable. GUI actions return refreshed accessibility state and screenshot artifacts; typed Python signatures catch invalid calls before they reach the desktop.
• Reusable after success. Code written for one task can be kept as a function or workflow instead of remaining an unstructured action trace.

Quick start

Accio currently supports macOS 14 or later. You will need Swift 6, Python 3.10 or later, Accessibility permission, and Screen Recording permission.

Version 0.0.1 is a source-only release. Build and install it locally using the scripts below; the project does not currently distribute a prebuilt, notarized application.

1. Install

From the repository root, run:

git clone https://github.com/Accio-Work-Lab/accio-cu.git
cd accio-cu
./scripts/install-macos.sh --verify --install-skill

This installs the app-bundled accio-computer-use command, its Python runtime, and the Accio skill for Codex. To install the skill for Claude Code instead:

./scripts/install-macos.sh --install-skill claude

The installer uses ad-hoc signing by default. A rebuilt ad-hoc app may have a new macOS permission identity and require Accessibility and Screen Recording to be granted again. To preserve the TCC identity across builds, install every build with the same certificate:

ACCIO_CODESIGN_IDENTITY="Developer ID Application: Example (TEAMID)" \
  ./scripts/install-macos.sh --verify --install-skill

To remove the app, daemon, CLI link, and Accio's scoped TCC grants:

./scripts/install-macos.sh --uninstall

2. Grant permissions

accio-computer-use setup

Enable Accessibility and Screen Recording for Accio Computer Use in System Settings → Privacy & Security.

3. Start the daemon

./scripts/install-daemon.sh install
./scripts/install-daemon.sh status
accio-computer-use daemon-status

Both status commands require a live current-user socket listener. A loaded LaunchAgent or a leftover socket file is reported as unhealthy.

Restart your agent, then give it a desktop task:

Open Finder, create a folder named Research Notes in Documents,
move the three PDF files into it, and verify the final folder contents.

The installed skill handles observation, interaction, and final verification.

Update an existing installation

After pulling the latest changes, update the CLI and restart its daemon with the following steps:

1. Reinstall the app, CLI, and agent skill:

``bash ./scripts/install-macos.sh --verify --install-skill ``

1. Manually reconfigure Accessibility and Screen Recording permissions

for Accio Computer Use in System Settings → Privacy & Security.

1. Uninstall the existing daemon:

``bash ./scripts/install-daemon.sh uninstall ``

1. Install the updated daemon:

``bash ./scripts/install-daemon.sh install ``

1. Run setup to verify the system permissions:

``bash accio-computer-use setup ``

One block, many tools

Pipe Python into accio-computer-use; the desktop functions are already loaded:

accio-computer-use \*, Yu Gu\*, Lanbo Lin, Yuanwu Xu, Li Cai,
and Sicong Xie

\* Equal contribution.

## Citation

If you use Accio Computer Use in your work, please cite this repository:

```bibtex
@misc{Yang2026Accio,
    author={Tianyuan Yang and Yu Gu and Lanbo Lin and Yuanwu Xu and Li Cai and Sicong Xie},
    title={Accio Computer Use},
    note={GitHub repository},
    howpublished={\url{https://github.com/Accio-Work-Lab/accio-cu}},
    year={2026}
}

License

Accio Computer Use is licensed under the [Apache License 2.0](LICENSE). Attribution information is in [NOTICE](NOTICE).

Source & license

This open-source MCP server is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: Accio-Work-Lab
• Source: Accio-Work-Lab/accio-cu
• License: Apache-2.0

Install and usage instructions live in the source repository linked above.