explaingit

liustack/modlens

Analysis updated 2026-08-16

1,991TypeScriptAudience · developerComplexity · 2/5Setup · easy

TLDR

A plugin that lets text-only AI coding models like DeepSeek read and understand images by converting pasted pictures into structured text. No file saving or manual paths needed.

Mindmap

mindmap
  root((repo))
    What it does
      Reads images for text AI
      Converts to structured text
      No file saving needed
    Integrations
      Claude Code
      DeepSeek Harness
      Codex and OpenCode
    Vision sources
      Gemini API
      OpenAI endpoints
      Anthropic API
      CLI logins
    Use cases
      Chat with diagrams
      Transcribe screenshots
      Analyze image data
    Audience
      Coders using text AI
      Cost conscious users

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Paste a UI screenshot into DeepSeek and ask it to write matching frontend code.

USE CASE 2

Drop a diagram into Claude Code and have it explain the architecture in text.

USE CASE 3

Transcribe text from an image directly in your coding assistant without saving a file.

What is it built with?

TypeScriptClaude CodeCodexOpenCodeGemini APIAnthropic API

How does it compare?

liustack/modlensdavidmonterocrespo24/velxiosimonlin1212/vibe-research
Stars1,9911,9902,005
LanguageTypeScriptTypeScriptTypeScript
Setup difficultyeasyeasymoderate
Complexity2/52/53/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min

Requires a vision source such as a free Gemini API key or a signed-in local CLI, but the installer auto-detects existing logins.

In plain English

ModLens is a plugin that gives text-only AI models the ability to read images. The flagship chat models from DeepSeek and GLM can only process text, so they cannot see or interpret pictures. ModLens solves this by acting as a vision engine that sits alongside these models. You paste an image directly into the chat, and the plugin converts it into structured text evidence the model can understand. There is no need to save the image to a file first or pass a file path manually. The plugin works across several coding assistant tools including Claude Code, Codex, OpenCode, and Pi. For DeepSeek Harness specifically, installation is a single command that adds a native tool called modlens_read_image. When you paste an image, ModLens sends it to a vision engine and returns a full transcription, layout regions in reading order, and lists of entities and relations. The model then quotes specifics from that structured output rather than guessing or inventing what the image contained. ModLens supports ten vision sources in total. Six are built-in providers: a free Gemini API key, any OpenAI-compatible endpoint, an Anthropic API key, the free Antigravity CLI, a signed-in Claude Code, and a signed-in Kimi Code. The other four come from reusing logins in local agent CLIs you may already have. If you configure more than one, they form a failover chain where fast API providers try first and slower CLI backups step in if needed. Every attempt is recorded so you can see which engine produced the result. Setup is designed to require minimal configuration. The installer checks what you already have on your machine and asks before reusing existing logins. If nothing is available, a free Gemini key from Google AI Studio is recommended, which brings each image read down to 5 to 10 seconds. Uninstalling is as simple as deleting a folder, with no hooks or proxy daemons left behind. The full README is longer than what was shown.

Copy-paste prompts

Prompt 1
I have ModLens installed with DeepSeek Harness. Here is a screenshot of a web page design, please read the image using the modlens_read_image tool and generate HTML and CSS that matches this layout.
Prompt 2
Paste this architecture diagram into Claude Code with ModLens. Read the image and then list all the components and their connections as a bulleted summary.
Prompt 3
I pasted a database schema diagram. Use ModLens to extract the entities and relations from the image, then write SQL CREATE TABLE statements based on what you find.
Prompt 4
I want to set up ModLens with a free Gemini API key. Walk me through getting the key from Google AI Studio and configuring it as my primary vision source with an Antigravity CLI backup.

Frequently asked questions

What is modlens?

A plugin that lets text-only AI coding models like DeepSeek read and understand images by converting pasted pictures into structured text. No file saving or manual paths needed.

What language is modlens written in?

Mainly TypeScript. The stack also includes TypeScript, Claude Code, Codex.

How hard is modlens to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is modlens for?

Mainly developer.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.