Analysis updated 2026-05-18
Keep a verifiable record of what an AI coding agent attempted, checked, and fixed during a task.
Give a future AI agent run prior failing evidence and a follow-up brief instead of starting from scratch.
Build a dataset of verified attempts and repairs for research, evaluation, or training purposes.
Reduce wasted tokens and cost on repeat AI coding sessions by reusing checked evidence.
| dunkeln/crucible | 0xallam/my-recipe | 0xhassaan/nn-from-scratch | |
|---|---|---|---|
| Stars | 0 | — | 0 |
| Language | Python | Python | Python |
| Last pushed | — | 2022-11-22 | — |
| Maintenance | — | Dormant | — |
| Setup difficulty | easy | moderate | moderate |
| Complexity | 3/5 | 2/5 | 4/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Installed as a Codex plugin via the Codex plugin marketplace, requires an existing Codex setup.
Crucible is a plugin for Codex, an AI coding agent, that changes how the results of an agent's work session are kept and used afterward. Normally when an AI agent fixes a bug or completes a task, the details of that work disappear into a chat transcript once the session ends. Crucible instead turns each attempt into a structured record with four parts: the attempt itself, a check that verifies whether it actually worked, the evidence produced by that check, and a decision about whether to promote the result as something worth keeping. The core rule behind the project is that nothing counts as a success unless a verifier confirms it. A verifier is a test or check that stays close to the specific project, since the project itself is what defines what counts as correct. Even a failed attempt is treated as useful, because it shows exactly where the agent's approach diverged from what the verifier expected, and that failure becomes information a future attempt can learn from. The project includes a benchmark comparing a plain task folder against a Crucible-managed task pack that includes prior failing evidence and a follow-up brief. On this test, the Crucible-assisted run showed a meaningful drop in wasted input tokens and billable cost alongside a higher-quality output, with the verifier passing on the final result. Crucible is installed as a Codex plugin through Codex's plugin marketplace and then used directly inside the repository where the work is happening. Humans stay responsible for deciding what gets promoted or kept, while Codex can propose tasks, verifiers, and repairs, and Crucible runs the checks and records what happened.
Crucible is a Codex plugin that turns each AI coding attempt into a verified record of what was tried, checked, and worth keeping, instead of a disappearing chat log.
Mainly Python. The stack also includes Python, Codex.
No license information is stated in the README.
Setup difficulty is rated easy, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.