Analysis updated 2026-05-18
Automatically generate structured video prompts from text, an image, and a video using DiffusionGemma.
Build a character motion transfer video workflow combining a reference image and a motion video.
Feed AI-written positive and negative prompts directly into an LTX video generation pipeline.
Verify a compressed NVFP4 model format is working correctly before running a full generation.
| exportanything/comfyui-diffusiongemmapromptbuilder | aimer-zero/redforge-ai | arthuryangx/nano-notebooklm | |
|---|---|---|---|
| Stars | 41 | 41 | 41 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 5/5 | 4/5 | 2/5 |
| Audience | developer | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires a CUDA GPU, an existing ComfyUI install, and several large model files downloaded separately from Hugging Face.
This project is a set of five custom nodes for ComfyUI, a visual, node-based tool for building AI image and video generation workflows. Rather than generating images or video itself, it uses an AI model called DiffusionGemma purely as a smart prompt writer, taking in text, an image, and a video as context, and producing a carefully constructed prompt for a separate video generation model called LTX to actually use. The five nodes work together in a chain: one loads the DiffusionGemma model itself, one combines your text description with an optional reference image and video into a single context object, one stores your target settings like video profile, duration, and aspect ratio, one asks DiffusionGemma to generate the final structured prompt based on all of that, and one splits that result apart into the individual pieces an LTX video workflow needs, such as the positive prompt, negative prompt, and resolution. The project ships a full example workflow for character motion transfer, where a reference image defines who appears in the video and a separate source video defines the motion, pose, and camera movement to apply. Using it requires downloading several large model files separately from Hugging Face, including the DiffusionGemma prompt model, the LTX diffusion model, supporting LoRA files, video and audio decoders, and a text encoder, each placed into a specific ComfyUI models folder. Setting this up requires a ComfyUI installation with a CUDA-capable GPU and several other community node packs installed through ComfyUI's manager. The project includes a verification script to confirm the specialized compressed model format it relies on is working correctly before attempting a real generation. It is released under the MIT license.
A set of ComfyUI nodes that use the DiffusionGemma AI model to write structured prompts for LTX video generation workflows, including character motion transfer.
Mainly Python. The stack also includes Python, ComfyUI, PyTorch.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.