explaingit

collbrogtr/comfyui-ideogram-autoprompter

Analysis updated 2026-05-18

21JavaScriptAudience · vibe coderComplexity · 2/5Setup · moderate

TLDR

A ComfyUI node that auto-generates the structured JSON prompts Ideogram 4 needs, using a vision AI model to turn a short description into a full scene layout.

Mindmap

mindmap
  root((ideogram-autoprompter))
    What it does
      Auto build JSON prompts
      Editable canvas regions
      Reference image input
    Tech stack
      ComfyUI plugin
      Qwen3-VL
      Gemini API
    Use cases
      Ideogram 4 workflows
      Scene layout editing
      Prompt automation
    Audience
      AI image creators

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Turn a short text description into a full structured JSON prompt for Ideogram 4.

USE CASE 2

Drop in a reference image and let the vision model build a matching scene layout.

USE CASE 3

Drag, resize, and edit element regions on a visual canvas before generation runs.

USE CASE 4

Use a local model by default or switch to Gemini with a pasted API key for captioning.

What is it built with?

ComfyUIJavaScriptQwen3-VLGemini

How does it compare?

collbrogtr/comfyui-ideogram-autoprompteramazingsyp/pokemon-ontologybinglehaepi/workingtable
Stars212121
LanguageJavaScriptJavaScriptJavaScript
Setup difficultymoderateeasyeasy
Complexity2/53/51/5
Audiencevibe coderresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Requires ComfyUI installed, plus a pip install of dependencies and a first-time download of the local Qwen3-VL model.

In plain English

This is a plugin for ComfyUI, which is a visual tool people use to build AI image-generation workflows by connecting nodes on a canvas. This particular node is for Ideogram 4, an image generator that requires prompts in a specific structured format, a JSON object that describes the background, the individual elements in the scene, where each element sits in the image, any text that should be rendered, and the color palette to use. Writing that JSON by hand is tedious, and this tool automates that step. You type a short description of what you want, and optionally drop in a reference image. When you click Generate, a vision AI model reads your input and builds the full structured caption for you, filling in all the required fields including bounding boxes that describe where each element should appear. The result is then shown on a visual canvas where you can drag, resize, and edit the regions before they get passed to Ideogram 4. The plugin supports a few different AI engines for building the caption. The default is a local model called Qwen3-VL that downloads automatically the first time you use it. To avoid keeping a large model in memory, it unloads after each generation by default. You can also use Gemini by pasting in a free API key, and the key is held only in memory for that session and never saved into your workflow file. Installation is done by copying the folder into ComfyUI's custom nodes directory and running a pip install for the dependencies. The generation step happens interactively inside the node's UI by pressing a button, not when the overall workflow graph runs. The node's output is the finished JSON string, which connects to Ideogram 4's prompt input in the rest of your workflow.

Copy-paste prompts

Prompt 1
Help me install comfyui-ideogram-autoprompter into ComfyUI's custom nodes folder and its dependencies.
Prompt 2
Explain how the node builds the structured JSON caption that Ideogram 4 needs from a short description.
Prompt 3
Show me how to edit the bounding box regions on the canvas before sending the prompt to Ideogram 4.
Prompt 4
Walk me through switching from the default Qwen3-VL model to Gemini using an API key.

Frequently asked questions

What is comfyui-ideogram-autoprompter?

A ComfyUI node that auto-generates the structured JSON prompts Ideogram 4 needs, using a vision AI model to turn a short description into a full scene layout.

What language is comfyui-ideogram-autoprompter written in?

Mainly JavaScript. The stack also includes ComfyUI, JavaScript, Qwen3-VL.

How hard is comfyui-ideogram-autoprompter to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is comfyui-ideogram-autoprompter for?

Mainly vibe coder.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.