Analysis updated 2026-05-18
Wrap a coding agent so it stops only when automated checks actually pass
Track a long-running agent task with logs and a heartbeat status file
Add a circuit breaker so an agent does not loop forever on a stuck bug
Compare an agent's fix against a performance baseline before accepting it
| thu-nmrc/openloop | bhartiyashesh/purelymailcalendar | equality-machine/claude-p | |
|---|---|---|---|
| Stars | 55 | 55 | 55 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | moderate | easy |
| Complexity | 3/5 | 4/5 | 3/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires Python 3.11+ and a JSON config file describing each loop stage.
OpenLoop is a small Python toolkit for wrapping any AI agent in a monitored feedback loop. The idea is that instead of telling an agent to keep trying until something works, you set up a workspace that tracks exactly what the agent is doing, when each step succeeds or fails, and when it should stop. The core loop goes through a fixed sequence: run the project to see if it works, scan for bugs, attempt a fix via any shell command or agent, verify the result with automated checks, optionally compare against a performance baseline, then write a summary and either continue or stop. All of these steps are configured in a single JSON file where you specify what command to run at each stage. A key design choice is that OpenLoop does not tie you to any specific AI model or editor. The fix and improve steps are just shell commands, so you can plug in any agent that runs from a terminal. Each command gets its own log file, and the current state, including which process is running, how far along it is, and what went wrong last, is always written to a compact JSON file called a heartbeat. The toolkit also includes guardrails to prevent runaway behavior: timeouts, stall detection, a circuit breaker that marks the task as blocked if too many consecutive steps fail, and baseline checks that require a measurable score to stay above a threshold before the loop treats anything as done. The project ships with a CLI that handles initializing a workspace, validating the configuration, running the loop, and printing current status. It is in alpha and works on Python 3.11 or later.
A Python toolkit that wraps any AI coding agent in a monitored loop: run, check, fix, verify, and repeat until the project actually works.
Mainly Python. The stack also includes Python, CLI, JSON config.
Use freely for any purpose, including commercial use, as long as you keep copyright and license notices.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.