explaingit

rgreenblatt/which_claude_is_k3

Analysis updated 2026-05-18

2PythonAudience · researcherComplexity · 2/5Setup · moderate

TLDR

An AI-generated research project investigating which frontier model Moonshot's Kimi K3 may have been trained on, using identity probes for comparison.

Mindmap

mindmap
  root((which_claude_is_k3))
    What it does
      Identity probes on Kimi K3
      Compares to Claude and GPT
      Compares to open models
    Notable trait
      Fully AI generated research
      No human verification
    Contents
      Full write up report
      Curated final codebase
      Progress log
    Use cases
      Read the findings
      Reproduce the figures

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Read the write-up to see how Kimi K3's responses were compared against reference models.

USE CASE 2

Rerun the curated code in final_codebase to reproduce the reported figures offline.

USE CASE 3

Study the progress log to see how a fully AI-generated research project evolved.

What is it built with?

Python

How does it compare?

rgreenblatt/which_claude_is_k30-bingwu-0/live-interpreter010zx00x1/faresnipe
Stars222
LanguagePythonPythonPython
Setup difficultymoderatemoderateeasy
Complexity2/52/52/5
Audienceresearchergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

The README gives no installation or run instructions, details are only in final_codebase's own README.

In plain English

This repository investigates which large language model Moonshot's Kimi K3 was likely trained on or influenced by. The author says the project uses identity probes, tests that compare model responses, applied to Kimi K3, related models in its lineage, some open source models used as a baseline, and reference calls to Claude and GPT models. The most striking detail in the README is a direct admission: every part of this project, including the experiment design, the code, the data collection, the analysis, and the final write up, was produced by an AI agent, described as Opus 4.8, working without human review of the results or claims. The author explicitly warns that the findings may contain errors and should not be trusted as reliable without someone independently checking the work. The repository points readers to a full report file for the detailed findings, and to a separate cleaned up folder that contains a curated, reproducible version of the code and results, including figures that can be regenerated offline from the results that are already included. The root of the repository is described as the original working tree used during development, with a progress log file that records the full history of how the project evolved. The curated folder is presented as the polished deliverable meant for people who just want to review or rerun the analysis without wading through the development history. Given the small size of this project, it does not describe installation steps, dependencies, or how to run the code, so those details are not available. The repository is written in Python and has not accumulated much attention yet, with only a couple of stars.

Copy-paste prompts

Prompt 1
Summarize the identity-probe method this project used to compare Kimi K3 against Claude and GPT models.
Prompt 2
Explain why the author says this research may not be reliable without independent verification.
Prompt 3
Show me how to regenerate the figures in final_codebase from the shipped results.

Frequently asked questions

What is which_claude_is_k3?

An AI-generated research project investigating which frontier model Moonshot's Kimi K3 may have been trained on, using identity probes for comparison.

What language is which_claude_is_k3 written in?

Mainly Python. The stack also includes Python.

How hard is which_claude_is_k3 to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is which_claude_is_k3 for?

Mainly researcher.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.