explaingit

konoeph/agentclaimguard

Analysis updated 2026-05-18

35PythonAudience · developerComplexity · 3/5LicenseSetup · easy

TLDR

A Python library that checks whether an AI agent's claims are backed by real evidence, tool results, or policy rules before they reach a user.

Mindmap

mindmap
  root((AgentClaimGuard))
    What it does
      Verifies claims
      Checks evidence
      Blocks unsupported answers
    Tech stack
      Python
      FastAPI
      LangGraph
      LangChain
    Use cases
      Numeric claim checks
      Compliance judgments
      RAG grounding
    Audience
      LLM app developers
      Agent builders
    Integration
      HTTP tool
      Framework adapter
      Evidence provider

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Block an agent's numeric claims when no calculator tool actually ran.

USE CASE 2

Add a verification checkpoint between an agent step and its final answer in LangGraph.

USE CASE 3

Wrap a LangChain Runnable so its output is checked against evidence before returning.

USE CASE 4

Expose claim verification as an HTTP tool for workflow platforms like Dify.

What is it built with?

PythonFastAPILangGraphLangChain

How does it compare?

konoeph/agentclaimguardalex-nlp/denoiserlbytedance-seed/cola-dlm
Stars353535
LanguagePythonPythonPython
Setup difficultyeasyhardhard
Complexity3/55/54/5
Audiencedeveloperresearcherresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 30min
Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

In plain English

AgentClaimGuard is a Python library that acts as a checkpoint between an AI agent and the user. When an AI language model produces an answer, the library checks whether the key claims in that answer are backed by actual evidence, tool outputs, or other sources you have provided. If a claim lacks the required support, the library blocks it and returns a status indicating why, so the answer can be sent for repair or human review instead of reaching the user unchecked. The library does not judge whether a claim is factually true in an absolute sense. It checks whether a claim meets the rules of a policy you define. For example, if your policy says a numeric conclusion like "revenue increased by 15%" requires a calculator tool result as evidence, and no such result was provided, the library returns a blocked status rather than passing the answer through. The design is meant to close the gap that exists in most AI pipelines, where retrieval gives context but does not guarantee the model used it, and tool calls happen but do not guarantee the model drew the right conclusion. The library is framework-agnostic and can plug into several common setups. It ships with adapters for LangGraph and LangChain, so it can sit as a node inside an existing agent workflow and route outputs to different next steps depending on the verification result. It also includes a FastAPI server that exposes an HTTP endpoint, which lets it be called from workflow platforms like Dify as a plain web request. Installing it is straightforward with pip. Additional optional packages bring in the server, LangGraph adapter, or LangChain adapter depending on which integration you need. The repository includes example scripts for each major use case, including claim extraction helpers that turn plain text answers into structured objects for the verification step, and a mapping pattern for connecting retrieved chunks from a RAG system into the evidence format the library expects. The project is available on PyPI and released under the Apache 2.0 license.

Copy-paste prompts

Prompt 1
Show me how to wrap my LangGraph agent node with AgentClaimGuard so unsupported claims get routed to human review.
Prompt 2
Write a Policy config for AgentClaimGuard that blocks any numeric claim without a matching tool result.
Prompt 3
Set up the AgentClaimGuard FastAPI server and show me how to call it from a Dify HTTP tool.
Prompt 4
Convert my RAG system's retrieved chunks into AgentClaimGuard Evidence objects.

Frequently asked questions

What is agentclaimguard?

A Python library that checks whether an AI agent's claims are backed by real evidence, tool results, or policy rules before they reach a user.

What language is agentclaimguard written in?

Mainly Python. The stack also includes Python, FastAPI, LangGraph.

What license does agentclaimguard use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

How hard is agentclaimguard to set up?

Setup difficulty is rated easy, with roughly 30min to a first successful run.

Who is agentclaimguard for?

Mainly developer.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.