explaingit

gnipbao/codex-whiteboard-video-skill

Analysis updated 2026-05-18

55PythonAudience · vibe coderComplexity · 3/5LicenseSetup · hard

TLDR

A Codex skill adapter that lets you ask an AI coding assistant to turn images into whiteboard hand-drawn animation videos, using a local Python rendering engine with no API keys required.

Mindmap

mindmap
  root((codex-whiteboard-video-skill))
    What it does
      Image to whiteboard video
      Stroke animation
      Codex skill wrapper
    Line-art Providers
      Informative Drawings
      Anime2Sketch
    Setup
      Install engine package
      Clone skill to Codex
      Download model weights
    Use Cases
      Photo animation
      Sketch videos
      AI workflow tool
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Convert a photo or illustration into a whiteboard hand-drawn animation video by asking Codex with a single natural language instruction

USE CASE 2

Generate a whiteboard animation of an anime-style sketch using the Anime2Sketch line-art model running locally on your machine

USE CASE 3

Add whiteboard video generation to a custom AI assistant workflow by installing the skill and engine

What is it built with?

PythonPyTorchffmpeg

How does it compare?

gnipbao/codex-whiteboard-video-skilljsingletonai/dejavukizuna-intelligence/irodori-tts-lite
Stars555653
LanguagePythonPythonPython
Setup difficultyhardeasyhard
Complexity3/52/54/5
Audiencevibe coderdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires cloning two upstream model repositories with full source code and downloading pre-trained weight files before the engine can run.

MIT for the skill wrapper, upstream model code and weights follow their own separate licenses.

In plain English

codex-whiteboard-video-skill is an adapter that lets the Codex AI coding assistant call a separate whiteboard video generation engine. The underlying engine, called whiteboard-video-engine, takes images (photos, SVG files, sketches, or scripts) and renders them as videos that look like a hand drawing the image on a whiteboard. This repository contains only the skill instructions and a thin wrapper script, the actual rendering code and AI models live in the companion engine repository. Once installed, you can invoke the skill by referencing its SKILL.md file inside a Codex session and describing what you want. The engine traces the image through a line-art extraction step (converting a photo or illustration to sketch lines), animates the drawing stroke by stroke with configurable stroke style and timing, and outputs an mp4 video. The line-art extraction uses one of two AI models: Informative Drawings (for contour and sketch-style output) or Anime2Sketch (for anime-style output). Both models require downloading their full upstream repositories along with their pre-trained weight files, not just the weights alone, because the engine imports Python modules from those repositories directly. Setting up the models is the most involved part of the installation. Installation has two steps: installing the Python engine package from GitHub, then cloning this skill repository into the Codex skills directory. A doctor command verifies the setup. No API keys are required since all processing runs locally. The README is written primarily in Chinese. This project is aimed at developers who want whiteboard video generation inside an AI coding assistant workflow. It is MIT licensed, though the upstream model code and weights follow their own separate licenses.

Copy-paste prompts

Prompt 1
Install codex-whiteboard-video-skill and its engine. Show me all the steps including installing the Python package, cloning the skill to ~/.codex/skills, and running the doctor check
Prompt 2
I want to convert a JPG photo into a 15-second whiteboard animation with rich stroke detail. Show me the Codex skill invocation and the equivalent CLI command
Prompt 3
How do I set up the Informative Drawings model for this skill? What directories and weight files do I need, and where exactly do they go in the project structure?
Prompt 4
What is the difference between the Informative Drawings and Anime2Sketch providers and which one should I use for a photograph of a person?

Frequently asked questions

What is codex-whiteboard-video-skill?

A Codex skill adapter that lets you ask an AI coding assistant to turn images into whiteboard hand-drawn animation videos, using a local Python rendering engine with no API keys required.

What language is codex-whiteboard-video-skill written in?

Mainly Python. The stack also includes Python, PyTorch, ffmpeg.

What license does codex-whiteboard-video-skill use?

MIT for the skill wrapper, upstream model code and weights follow their own separate licenses.

How hard is codex-whiteboard-video-skill to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is codex-whiteboard-video-skill for?

Mainly vibe coder.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Scan in gitsafehub Deploy in gitdeployhub gnipbao on gitmyhub

Verify against the repo before relying on details.