Analysis updated 2026-08-11 · repo last pushed 2026-06-04
Build a legal research assistant that answers multi-step questions across case files while citing sources.
Create an internal knowledge tool that reasons over company documents with built-in fact-checking.
Set up a document analysis system for long technical manuals that avoids hallucinated answers.
Watch the AI plan and verify each reasoning step live in a visual demo using the included Harry Potter example.
| nirdiamant/controllable-rag-agent | trekhleb/machine-learning-experiments | karpathy/cryptos | |
|---|---|---|---|
| Stars | 1,618 | 1,810 | 1,915 |
| Language | Jupyter Notebook | Jupyter Notebook | Jupyter Notebook |
| Last pushed | 2026-06-04 | — | 2021-06-21 |
| Maintenance | Maintained | — | Dormant |
| Setup difficulty | moderate | moderate | moderate |
| Complexity | 4/5 | 3/5 | 4/5 |
| Audience | developer | researcher | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires an API key from an AI model provider (OpenAI, Anthropic, etc.) and Python environment setup with LangChain and related dependencies.
The controllable-rag-agent project helps you build an AI system that can answer genuinely complicated questions about your own documents, the kind of multi-step questions that simpler AI tools get wrong. Instead of just searching for relevant paragraphs and hoping for the best, it breaks hard questions into smaller pieces, plans how to tackle each one, and verifies its answers along the way. Here is how it works in plain terms. You load your documents (the demo uses the first Harry Potter book as an example). The system creates summaries of each section and stores everything in a searchable format. When you ask a question, it first strips out specific names and details to create a generic version of your question, this prevents the AI from relying on what it already knows and forces it to work only from your documents. Then it builds a step-by-step plan. For a question like "How did the protagonist defeat the villain's assistant?" it would figure out who the protagonist is, who the villain is, who the assistant is, search for relevant interactions, and piece together the answer. After each step, it checks whether the information it found actually came from your documents rather than being invented, and it adjusts its plan as new information comes in. This is useful for anyone who needs an AI to reason carefully over a specific document set, a legal team analyzing case files, a researcher working through a long technical manual, or a product team building an internal knowledge tool where accuracy really matters and hallucinations are unacceptable. The project is built as Jupyter notebooks with a visual demo interface, so you can watch the agent think through each step in real time. It is designed to be controllable rather than a black box: you can see and influence how it plans, retrieves, and verifies. It uses established tools like LangChain and evaluation metrics from Ragas to measure answer quality, and it works with several different AI model providers so you are not locked into one.
An AI system that answers complex multi-step questions about your own documents by breaking questions into smaller pieces, planning each step, and verifying answers against your text instead of guessing.
Mainly Jupyter Notebook. The stack also includes Jupyter Notebook, LangChain, Ragas.
Maintained — commit in last 6 months (last push 2026-06-04).
No license information is provided in the repository, so usage rights are unclear.
Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.