explaingit

gnipbao/whiteboard-video-engine

Analysis updated 2026-05-18

35PythonAudience · vibe coderComplexity · 3/5LicenseSetup · moderate

TLDR

A Python CLI that converts photos, illustrations, and SVGs into whiteboard-style MP4 videos, animating the image stroke by stroke with a simulated hand overlay and optional color fill.

Mindmap

mindmap
  root((whiteboard-video-engine))
    What it does
      Photos to whiteboard video
      SVG and lineart to MP4
      Stroke-by-stroke animation
    Pipeline
      Neural line art extraction
      Stroke sorting and smoothing
      Hand gesture overlay
      Contour color fill
      FFmpeg encodes output
    Hand Styles
      asian black white children
      procedural or none
    Models
      Informative Drawings photos
      Anime2Sketch illustrations
    Audience
      Content creators
      Developers and designers
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Convert a portrait photo or illustration into a whiteboard drawing video where the image is animated stroke by stroke, then export as MP4 for social media or presentations.

USE CASE 2

Turn an anime panel or manga illustration into a whiteboard-style video using the Anime2Sketch model with contour color fill.

USE CASE 3

Batch-process SVG files into whiteboard videos for an explainer video or educational content pipeline using the CLI.

What is it built with?

PythonFFmpegPyTorchNumPyPillow

How does it compare?

gnipbao/whiteboard-video-enginezhuohangu/peektomribbens/factorios
Stars353536
LanguagePythonPythonPython
Setup difficultymoderatemoderatehard
Complexity3/54/54/5
Audiencevibe coderresearcherops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

FFmpeg must be installed, line art neural network models require manual setup with downloaded weights in a specific directory layout.

Free to use for any purpose including commercial use as long as you keep the copyright notice. Upstream model weights have their own separate licenses.

In plain English

Whiteboard Video Engine is a Python command-line tool that takes a photo, illustration, SVG, or line drawing and converts it into a video where the image is drawn stroke by stroke, like someone drawing on a whiteboard. The output is an MP4 file. The tool is designed for local use and focuses on the rendering mechanics rather than cloud processing. The core pipeline runs in several stages. A local neural network model first extracts line art from the input image, supporting realistic photos and anime-style illustrations via two different model backends. The extracted strokes are then sorted and smoothed, and a simulated hand gesture follows along each path as the lines are drawn. After the line work is complete, color can optionally be added using a contour-based fill effect. FFmpeg handles the final video encoding. The hand overlay comes in four built-in gesture styles (asian, black, children, white) or can be disabled entirely. Stroke detail level is configurable (balanced, rich, max) and the tool auto-detects appropriate line thickness from the input. A --draw-text flag converts a short title string into a handwritten path that gets drawn into the video. Installing the tool requires Python and FFmpeg. The line art models (Informative Drawings for photos, Anime2Sketch for illustrations) are optional but improve results with non-SVG inputs. Each model backend needs to be set up as a separate project directory with downloaded weights, then pointed to via environment variables. A "whiteboard doctor" command checks whether all dependencies are in place. The license is MIT. Model code and weights from the upstream projects keep their own separate licenses.

Copy-paste prompts

Prompt 1
I want to convert a portrait photo into a whiteboard hand-drawing video. Walk me through installing the Informative Drawings model and running the render-photo command with hand and color-fill options.
Prompt 2
How do I set up the Anime2Sketch model for whiteboard-video-engine? What files do I need to download and where do they go in the directory layout?
Prompt 3
I want a title text hand-drawn at the start of my whiteboard video. How does the --draw-text flag work and how is the text path rendered?
Prompt 4
Show me how to batch-process a folder of SVG files into whiteboard MP4 videos using the whiteboard-video-engine CLI in a shell script.
Prompt 5
What does the contour-wipe color-fill mode do and how is it different from brush-scan or fade when applied after the line-drawing animation?

Frequently asked questions

What is whiteboard-video-engine?

A Python CLI that converts photos, illustrations, and SVGs into whiteboard-style MP4 videos, animating the image stroke by stroke with a simulated hand overlay and optional color fill.

What language is whiteboard-video-engine written in?

Mainly Python. The stack also includes Python, FFmpeg, PyTorch.

What license does whiteboard-video-engine use?

Free to use for any purpose including commercial use as long as you keep the copyright notice. Upstream model weights have their own separate licenses.

How hard is whiteboard-video-engine to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is whiteboard-video-engine for?

Mainly vibe coder.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Scan in gitsafehub Deploy in gitdeployhub gnipbao on gitmyhub

Verify against the repo before relying on details.