explaingit

arnie936/llm-prompting-tests

Analysis updated 2026-05-18

16Audience · developerComplexity · 2/5Setup · easy

TLDR

A benchmark collection of 16 hard prompts, mostly in German, that test AI coding assistants on building self-contained apps and games.

Mindmap

mindmap
  root((llm prompting tests))
    What it does
      16 hard prompts
      Mostly German
      Single file constraint
    Tech stack
      HTML
      C++
    Use cases
      Test coding assistants
      Benchmark AI models
      Study prompt design
    Audience
      Developers
      AI researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Test how well an AI coding assistant handles a complex single-file simulation prompt.

USE CASE 2

Benchmark an AI's ability to build a 3D game with physics and AI opponents.

USE CASE 3

Compare different AI models by running them against the same prompt set.

USE CASE 4

Study prompt design patterns that require self-contained, dependency-free output.

What is it built with?

HTMLC++

How does it compare?

arnie936/llm-prompting-tests920linjerry-stack/capital-studioaahonarmand/neticu
Stars161616
LanguagePythonSwift
Setup difficultyeasyeasyeasy
Complexity2/53/52/5
Audiencedeveloperresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min

Contains only prompt text, no runnable code is included in the repository.

In plain English

This repository is a collection of 16 challenging prompts designed to test how well AI models, coding assistants, and AI agents perform on complex technical tasks. The prompts are written primarily in German with some in English, and each one asks an AI to build something substantial and self-contained from scratch. The prompts cover a wide range of simulation, game development, and creative engineering tasks. Examples include building a working beehive simulation as a single HTML file, complete with hexagonal cells, bee roles, resource management, and environmental factors. Another asks for a full 3D motorcycle racing game with AI opponents, collision physics, and a minimap, also in a single HTML file. A first-person shooter prompt specifies mouse-look controls, enemy AI with patrol and chase behavior, multiple weapons, and a self-diagnosis check at startup. One prompt asks for a skateboarding game written entirely in a single C++ source file. Another requests a tower defense game with a built-in map editor and a post-wave balancing indicator. A recurring theme across the prompts is the requirement to pack everything into a single file with no external dependencies. Several prompts also ask the AI to include a short section in the code explaining design decisions, and some ask for a self-diagnostic check at startup to confirm that core systems initialized correctly. These constraints test whether a model can produce code that is not just functional but also organized and self-aware about its own outputs. The collection appears to be a personal benchmark suite rather than a library or tool. There is no code in the repository itself, only the prompt texts. Each prompt is formatted as a standalone specification that could be pasted directly into any AI chat interface. The full README is longer than what was shown.

Copy-paste prompts

Prompt 1
Give me one of these prompts and have me build it as a single HTML file.
Prompt 2
Translate this German prompt into English and explain what it's testing for.
Prompt 3
Walk me through the beehive simulation prompt's required features.
Prompt 4
Show me how the self-diagnostic startup check requirement works across prompts.

Frequently asked questions

What is llm-prompting-tests?

A benchmark collection of 16 hard prompts, mostly in German, that test AI coding assistants on building self-contained apps and games.

How hard is llm-prompting-tests to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is llm-prompting-tests for?

Mainly developer.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.