Analysis updated 2026-05-18
Train an AI agent to control a desktop by clicking, typing, and reading the screen like a human.
Run thousands of parallel desktop environment resets for large scale reinforcement learning experiments.
Benchmark how fast an agent can act on screenshots in a simulated desktop environment.
| meirtz/shinken | 1lystore/awaek | actashui/sjtu-ppt-template-skill | |
|---|---|---|---|
| Stars | 13 | 13 | 13 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 5/5 | 2/5 | 2/5 |
| Audience | researcher | vibe coder | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires Docker and Python 3.10 or above, and the project is still in early, partly experimental stages.
Shinken is an open-source project for researchers who want to train AI agents to control real desktop computers. Think of it as a training gym where the AI learns to click, type, and navigate a computer screen the same way a person would, by looking at pixels rather than through special shortcuts built into individual apps. The goal is to make that training process faster and cheaper at scale. The core problem Shinken solves is repetition. When training an AI agent on computer tasks, you typically have to reset the desktop to a known state thousands of times per experiment. Normally that means rebooting, reinstalling software, or re-navigating to a specific point in a workflow, which wastes time. Shinken takes a snapshot of a running desktop at any moment, then creates copies of that exact state in roughly 0.1 to 0.6 seconds each. You reach a state once and fork it as many times as you need, rather than rebuilding it from scratch every time. The scale claims are specific and backed by benchmarks the authors say are rerunnable. According to the README, a single laptop can hold over 8,000 live desktop environments at once on a single processing thread, and 128 fully booted real desktops can be launched in about 7 seconds. Each step where the agent acts on the desktop and takes a new screenshot costs around 13 milliseconds. For developers who want to connect their own code, Shinken provides a Python interface. You create a session, and that session gives you a live desktop where you can call functions like click, type_text, and screenshot. The same interface is designed to work across Docker-based local desktops and other backends. The project is in early stages. The README is direct about which parts are working today under automated tests and which parts are still design. It uses Docker and Python 3.10 or above, and is licensed under Apache 2.0. The full README is longer than what was shown.
An open source training gym for AI agents that lets researchers instantly clone thousands of live desktop environments so agents can learn to click and type like a person.
Mainly Python. The stack also includes Python, Docker.
Use freely for any purpose, including commercial use, as long as you keep the copyright and license notice.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.