explaingit

techarohq/anubis

Analysis updated 2026-05-18

19,300GoAudience · pm founderComplexity · 3/5LicenseSetup · easy

TLDR

A reverse proxy that blocks AI crawler bots from scraping your website by forcing them to solve challenges before accessing your content.

Mindmap

mindmap
  root((repo))
    What it does
      Blocks AI bots
      Reverse proxy
      Challenge-based
    How it works
      Evaluates requests
      Forces CAPTCHA-like
      Lightweight design
    Use cases
      Protect indie sites
      Stop data scrapers
      Save bandwidth
    Tech stack
      Go
      HTTP proxy
    Audience
      Site owners
      Small communities
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Protect a small community forum or indie website from AI bots consuming bandwidth and server resources.

USE CASE 2

Block automated scrapers from harvesting content while allowing legitimate human visitors through.

USE CASE 3

Run a lightweight gatekeeper in front of your site without relying on expensive third-party services like Cloudflare.

What is it built with?

Go

How does it compare?

techarohq/anubisprobelabs/goreplaybettercap/bettercap
Stars19,30019,28819,198
LanguageGoGoGo
Setup difficultyeasymoderatemoderate
Complexity3/53/54/5
Audiencepm founderops devopsops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min
Use freely for any purpose including commercial, as long as you keep the copyright notice.

In plain English

Anubis is a security tool that sits in front of your website and blocks AI crawler bots from hammering it with endless automated requests. Named after the Egyptian god who weighed souls to determine their fate, Anubis evaluates each incoming HTTP request and forces suspicious visitors to complete a challenge before they're allowed through, much like a CAPTCHA, but specifically designed to stop AI data scrapers. The problem it solves is real: AI companies send automated bots that crawl websites constantly, consuming bandwidth and server resources at a scale that can overwhelm small community sites, forums, and indie projects. Anubis acts as a reverse proxy (a gatekeeper that all traffic passes through) and challenges connections that look like bots before they reach your actual server. You'd use it if you run a website you want to protect from AI scraping, especially if you can't or won't use Cloudflare. The project itself calls it "a nuclear response", it will also block smaller legitimate scrapers like archive bots unless you explicitly allow them via configuration. It's designed to be lightweight so small communities can afford to run it. The tech stack is Go.

Copy-paste prompts

Prompt 1
How do I set up Anubis as a reverse proxy to protect my website from AI scrapers?
Prompt 2
What configuration options does Anubis have to whitelist legitimate bots like archive crawlers?
Prompt 3
Can I use Anubis to add bot-blocking challenges to my existing website without major changes?
Prompt 4
How does Anubis compare to using Cloudflare for blocking AI bots, and what are the trade-offs?

Frequently asked questions

What is anubis?

A reverse proxy that blocks AI crawler bots from scraping your website by forcing them to solve challenges before accessing your content.

What language is anubis written in?

Mainly Go. The stack also includes Go.

What license does anubis use?

Use freely for any purpose including commercial, as long as you keep the copyright notice.

How hard is anubis to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is anubis for?

Mainly pm founder.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Scan in gitsafehub Deploy in gitdeployhub techarohq on gitmyhub

Verify against the repo before relying on details.