explaingit

qwenlm/qwen-mm-plugins

Analysis updated 2026-08-13

2,387PythonAudience · developerComplexity · 2/5LicenseSetup · moderate

TLDR

A collection of plugins that add image, video, audio, and 3D understanding to coding agents like Claude Code and Gemini CLI.

Mindmap

mindmap
  root((Qwen MM Plugins))
    What it does
      Adds multimodal skills to agents
      Reads images video and audio
      Works with CAD and 3D tools
    Tech stack
      Python
      MCP servers
      DashScope API
    Use cases
      Summarize a PDF or video
      Transcribe audio with speaker labels
      Model and render in Blender
    Audience
      Developers
      Vibe coders
      Researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Give a coding agent the ability to read and summarize images, PDFs, and videos

USE CASE 2

Transcribe a meeting recording with speaker labels and timestamps

USE CASE 3

Build a searchable memory of a long video for question answering

USE CASE 4

Use Blender or FreeCAD workflows directly from an AI agent

What is it built with?

PythonMCPDashScopeffmpeg

How does it compare?

qwenlm/qwen-mm-pluginskarpathy/rendergitideogram-oss/ideogram4
Stars2,3872,3732,406
LanguagePythonPythonPython
Last pushed2025-08-212026-06-30
MaintenanceQuietMaintained
Setup difficultymoderateeasymoderate
Complexity2/51/53/5
Audiencedeveloperdeveloperdesigner

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Core capability needs no API key, but cloud vision, search, and CAD capabilities need provider keys or desktop apps like Blender.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice and note any changes you made.

In plain English

Qwen-MM-Plugins is a set of add-ons that give AI coding agents the ability to understand images, video, audio, and other files, not just text. It plugs into several existing agent tools, including Claude Code, Codex, Qoder, OpenClaw, Qwen Code, and Gemini CLI, using a guided installer that adds each capability using that tool's normal install process. Each capability installs as a combination of a skill and, in most cases, a companion server the agent can call. The core capability lets an agent read images and video and visualize documents, code, data, and 3D files without needing an API key, though it does need ffmpeg installed for audio and video. Other capabilities add more: vision and OCR through Qwen's cloud models, web and reverse image search, building a searchable memory of long videos for question answering, generating and editing images, video, and audio, working inside Blender for 3D modeling and rendering, working inside FreeCAD for parametric CAD design, and creating narrated Chinese math and science explainer videos. Once a capability is installed, using it is meant to feel natural: you reference a file with an @ symbol in your message and describe what you want, such as summarizing a page of a PDF, transcribing a video with speaker labels, or identifying where a photo was taken, and the relevant tool is selected automatically. Some capabilities work entirely locally, while others need API keys from providers like DashScope, Serper, Exa, or Tavily, and some require desktop applications such as Blender or FreeCAD to already be installed on the system. The installer includes steps to configure credentials and verify that dependencies are in place. The project is released under the Apache 2.0 license, with separate attribution notices for the third-party Blender and FreeCAD integrations.

Copy-paste prompts

Prompt 1
Install Qwen-MM-Plugins from https://github.com/QwenLM/Qwen-MM-Plugins into my Claude Code setup
Prompt 2
Using Qwen-MM-Plugins, explain what the core capability can do without an API key
Prompt 3
Show me how to set up the search capability in Qwen-MM-Plugins with a Serper API key
Prompt 4
Walk me through installing the Blender capability from Qwen-MM-Plugins for 3D modeling

Frequently asked questions

What is qwen-mm-plugins?

A collection of plugins that add image, video, audio, and 3D understanding to coding agents like Claude Code and Gemini CLI.

What language is qwen-mm-plugins written in?

Mainly Python. The stack also includes Python, MCP, DashScope.

What license does qwen-mm-plugins use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice and note any changes you made.

How hard is qwen-mm-plugins to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is qwen-mm-plugins for?

Mainly developer.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.