Analysis updated 2026-05-18
Protect a data field or edge case from being silently dropped when an AI agent consolidates duplicate functions.
Add a hand written census that reconciles against test markers to catch deleted or unregistered probes.
Use alongside the ponytail skill to prevent both code bloat and silent data loss during refactors.
| tseno26/probefish | 0xkinno/neuralvault | 0xmayurrr/ai-contractauditor | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | TypeScript | TypeScript | TypeScript |
| Setup difficulty | easy | hard | easy |
| Complexity | 2/5 | 4/5 | 2/5 |
| Audience | developer | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires copying a single SKILL.md file into a Claude Code skills directory.
probefish is a skill for Claude Code that catches a specific kind of AI agent mistake: silently losing data when it changes the shape of code. This often happens when an agent merges several near duplicate functions into one, and the resulting diff looks clean and the tests still pass, but a field or edge case that only one of the original functions handled has quietly disappeared. Nothing errors, and the loss might not surface until much later, or never. The tool works by having the agent plant a small, verified test called a marker before making a change that moves data between forms, such as from a form to app state to an API to a database. Each marker pins down one specific thing that must survive the change. To make sure a marker actually works, it has to call the real production code rather than a copy of itself, and the process includes deliberately breaking the protected behavior to confirm the marker turns red, proving it is not a test that would pass no matter what. Every planted marker is also recorded by hand in a separate file called a census. A reconciler test compares the markers actually present in the test suite against what the census says should exist, catching two problems: a marker that was quietly deleted later, called lost, and a marker present but never recorded, called an orphan. Keeping the census hand written and separate from the code is what makes a later deletion show up as a mismatch instead of just shrinking the test count unnoticed. The project is inspired by a lab technique called Fluorescence In Situ Hybridization, which uses a glowing probe to reveal one specific kind of genetic damage that would otherwise be invisible. It is meant to complement another skill called ponytail, which focuses on preventing unnecessary code bloat, while probefish focuses on making sure data survives when that code does get consolidated. Installation is a matter of copying a SKILL.md file into Claude Code's skills folder, either globally or per project.
A Claude Code skill that catches AI agents silently losing data during code refactors by planting small verified test markers on invariants before changes are made.
Mainly TypeScript. The stack also includes TypeScript, Node.js, Vitest.
License not stated in the README.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.