0xalexhex/redjudge

RedJudge is a testing tool for checking how well an AI language model resists being tricked into producing content it should refuse, sometimes called jailbreaking. It is meant for authorized safety testing, not for causing real harm, and it ships only mild, safe test prompts by default. If you want to run it against real harmful content benchmarks, you need to supply those datasets yourself through a separate download script, since none of that content is included in the project itself. The tool works by combining four pieces you can mix and match: a behavior, meaning the type of prompt you are testing with, an attack method, meaning a technique for trying to get past the model's safety training, a target, meaning the specific AI model being tested, whether that is a locally running model, one accessed through an API, or in specific authorized cases a web chat interface, and a judge, meaning a system that grades whether the attack actually succeeded. Rather than relying on one single grading method, which can produce misleading numbers, it combines multiple established grading systems together so the final score is more trustworthy. Beyond basic single attempt attacks, it includes ready made test suites for newer categories of risk: hidden instructions smuggled into content the model reads, an AI agent being tricked through fake tool results into taking a harmful action like deleting something or sending money, and hidden instructions written as text inside an image shown to a model that can see images. There is also a persistent chat mode for holding an extended, multi-turn conversation with a target model to test whether repeated pressure over many messages can wear down its defenses. The README lists several capabilities the project does not yet have, including certain advanced attack techniques that require direct access to a model's internal workings, and notes these are planned for future development. The project is set up to be extended with your own testing methods by writing a small plugin. No license file is mentioned in the parts of the README reviewed, so its usage terms are unclear.