DSH Marketplace

dsh-tool-describe-image

zhu1090093659/dsh-web-ui#packages/dsh-tool-describe-image

A `describe_image` vision tool for text-only models: images (local path, URL, attachment) go to a configurable OpenAI-compatible vision endpoint and only the returned text enters the session.

8,594561TypeScriptApache-2.0Source

Install

Add dsh-tool-describe-image to DeepSeek Harness

This plugin lives in a subdirectory of a larger repository, and `dsh plugin add` cannot reach it — it forwards to pnpm, which reads everything after `#` as a git branch or commit. Clone the repository and add the plugin through DSH's plugin panel using a repository source, or ask the author to publish it to npm.

What happened when we ran it

Installed cleanly when we ran it

Every command here is run in a throwaway container against a clean profile, and the result is whatever the harness recorded — not a guess from the source. Last run 1mo ago.

Show it in your README

install verified — dshmarketplace

For maintainers: the badge serves this listing's latest sandbox verdict, so a re-run updates it on its own — and it links readers to the full result here.

Due diligence

Before you install dsh-tool-describe-image

  • Source of record: zhu1090093659/dsh-web-ui — present in the community registry that DSH's own plugin market installs from.
  • Licensed under Apache-2.0.

Security

What installing dsh-tool-describe-image runs

Build scripts

No build script was blocked in our run.

Source: our sandbox install, 1mo ago.

Install hooks

package.json declares no preinstall, install or postinstall script.

Source: package.json on GitHub, read at our last sync. prepare is not recorded; it runs only on a GitHub install, and shows up under build scripts when pnpm blocks it.

README mentions

Neither shell commands nor credentials.

Source: a keyword match on the README — a hint about what the plugin touches, not an analysis of its code.

Not an audit. These are the record of one install and two text scans; nobody has read this plugin's code on your behalf. Plugins run with your agent's permissions.

The AI take

What it is — dsh-tool-describe-image is an image description tool for text-only models. It sends local paths, URLs or attachments to a configurable OpenAI-compatible vision endpoint and only the returned text enters the session.

Who it is for — When using text-only models in DeepSeek Harness on tasks involving image inputs, this plugin is suitable for installation. Users who rely on built-in vision capabilities in their models can choose not to install it, as they have native image support.

Watch out — Sandbox testing in a new profile showed successful installation and registration with no obvious pitfalls found. No issues were detected in static checks.

The verdict — I would install it because it allows text-only models to handle image inputs in the session.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.

What dsh-tool-describe-image does

Three image inputs pass through a vision relay and emerge as text for a model.

dsh-tool-describe-image is a DeepSeek Harness plugin that adds a describe_image vision tool for text-only models. It accepts an image from a local path, URL or attachment, sends that image to a configurable OpenAI-compatible vision endpoint, and passes only the endpoint's returned text into the session. The image itself is not presented to the text-only model through this tool.

DeepSeek Harness is the intended host for the tool. It is suited to agents that need image descriptions while using a model without native vision input, provided an OpenAI-compatible vision service is available. The plugin is the wrong choice when the selected model already handles images directly, or when sending images to an external or separately configured vision endpoint is not acceptable. The supplied documentation identifies the endpoint as configurable but does not specify its configuration key, default, authentication method or installation command.

dsh-tool-describe-image documentation

What dsh-tool-describe-image does

dsh-tool-describe-image provides the describe_image command to DeepSeek Harness. The command is intended for text-only models that need information extracted from an image. Its input may be:

  • a local image path;
  • an image URL; or
  • an image attachment.

DeepSeek Harness sends the selected image to a configurable OpenAI-compatible vision endpoint. The endpoint's returned text is then added to the session. The image is not itself passed into the text-only model as a vision input.

Configuring dsh-tool-describe-image

The vision endpoint is configurable, so deployments can select an OpenAI-compatible service rather than relying on a fixed provider. The supplied README does not name the configuration key, its default value, an environment variable, or an authentication setting. Those details must therefore be obtained from the package's configuration surface or source before deployment.

How dsh-tool-describe-image behaves

The plugin forms a boundary between image input and the text-only session:

  1. describe_image receives a local path, URL or attachment.
  2. The image is sent to the configured vision endpoint.
  3. Only the returned description or other response text enters the DeepSeek Harness session.

This makes the tool useful when the agent's primary model cannot consume image data directly, while keeping the session input described by text returned from the vision service.

Requirements and limits

DeepSeek Harness must host the plugin, and a reachable OpenAI-compatible vision endpoint must be configured. The source excerpt documents no platform-specific support, version requirement, command-line flags or one-line installation method. The tool is not necessary for a model that already supports image input, and endpoint availability and compatibility remain prerequisites for obtaining a result.

Written from the project's own documentation and kept in sync with it. Where the two disagree, the source is authoritative — read the README on GitHub

Same category

Alternatives to dsh-tool-describe-image

esp32-iphone-agent

onehumanbeing

4.4k

Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.

Installed cleanly when we ran it

GitHub sourceSwiftyesterday

AI review

esp32-iphone-agent

What it is — Connects an OpenAI-compatible vision model to a physical iPhone: ESP32-S3 AirPlay for the screen, USB HID for taps, swipes, and typing.

Who it is for — You are inside DeepSeek Harness with an OpenAI-compatible vision model and need it to finish a live iPhone flow such as setting a repeating alarm, without a Mac, a developer account, or a jailbreak. Skip it when the phone is below iOS 18 or you have no flashed ESP32-S3 — the receiver and the HID device are simply not there.

Watch out — The phone joins the board's hotspot for AirPlay while model calls go out over cellular; AssistiveTouch stays on, and you supply the vision API key or token. The pointer is relative, so the app wiggles it to re-find and correct, and the plugin runs shell commands. A clean profile accepted the install and registered it.

The verdict — A green harness install is not a working phone; I would wait until TestFlight already shows a stable mirror and pointer before adding this plugin to a profile.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
2Source

modlens

liustack

4.4k

Vision bridge for text-only models: paste an image, get structured JSON evidence (OCR, layout, semantics).

Installed cleanly when we ran it

npm packageTypeScript22d ago

AI review

modlens

What it is — A DSH plugin that turns a pasted image into structured JSON evidence (OCR, reading-order layout, entities and relations) for text-only models.

Who it is for — You work in DSH on DeepSeek-V4-Flash, DeepSeek-V4-Pro, GLM-5.3, or MiMo Pro and need to inspect screenshots or scans those models cannot see. If your default route is already GLM-5.3-Flash or anything the host marks as native vision, skip it; those models are not wrapped and keep native paste.

Watch out — A clean-profile install registered with the harness. Reads reuse a Claude Code, Codex, OpenCode, or Pi login, or Antigravity CLI / Gemini / OpenAI-compatible keys; a free Gemini key is quoted at 5–10 seconds per read, with comma-separated keys rotating on auth, rate-limit, or quota failures. It executes shell commands. Capture hotkey is a separate plugin, dsh-screenshot.

The verdict — I'd keep it for the auto-wrapped (modlens vision) entries on every eligible provider route, including extras like opencode-go or zai, not because it ships any local vision runtime.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
1Details

为纯文本模型"看图“设计更好的视觉工具箱和技能,支持多图理解,图片问答,前端UI还原、GUI 自动化等,并可选无缝接入多个主流agent,直接识别粘贴图片| A vision toolkit and skill designed for text-only llms — image Q&A, long-screenshot OCR, frontend UI restoration, and GUI automation, with optional seamless integration for Codex, Claude Code, Pi, Oh My Pi, and OpenCode

Installed cleanly when we ran it

GitHub sourcePython25d ago

AI review

agent-vision-toolkit

What it is — CLI tools and a skill that let a text-only agent do multi-image Q&A, long-screenshot OCR, frontend restoration, and GUI automation.

Who it is for — You run DeepSeek in DeepSeek Harness, rebuilding UIs from mockups or driving a GUI, and the model never sees the pixels. If the agent you actually work in is already multimodal and can read a pasted screenshot, this CLI layer does not enter that loop.

Watch out — It installed on a fresh profile and the harness registered it. You pull it from GitHub source and the agent must be able to run shell CLIs. Seamless paste-in images need an extra local proxy; the ten structured DSH tools live in the dsh-vision-toolkit submodule and are absent until you init it.

The verdict — I would add it so vision sits in the harness and DeepSeek can stay the model I work with.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
1Source

Free vision for text-only agents: built-in keyless vision chain plus pixel tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG trace, cutout, screenshots); paste an image to use it.

Installed cleanly when we ran it

npm packageJavaScript14d ago

AI review

dsh-vision-router

What it is — Gives text-only DeepSeek Harness agents a vision chain and pixel-level tools; enable Vision beside the composer, then attach an image.

Who it is for — You run a text-only model in DeepSeek Harness on error screenshots, UI coordinates, OCR, or mockup diffs, and the chat model cannot take pixels. Skip it if images must stay on the machine and you will not wire a local vision backend.

Watch out — In a clean profile it installed and harness registered it. A fresh install ships an anonymous OVHcloud fallback, so images or crops, the vision prompt, and request metadata leave the machine by default — no key is not offline. It also runs shell commands.

The verdict — I'd add it to the profile I already live in: seeing as a repeatable tool turn, not another chat window that accepts pictures.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
1Details

Vision for text-only models: paste an image and the model switches to a Vision Toolkit variant for image Q&A, multi-image comparison, long-screenshot OCR, screenshot-to-UI reproduction, element grounding, and pixel diff. No API key by default — images are processed by the author-hosted free service, 100 per machine per day; configurable to your own provider.

DeepSeek Harness 0.2.2-rc.1 refuses the latest release

npm packageTypeScript13d ago

AI review

dsh-vision-toolkit

What it is — A DeepSeek Harness plugin that, on image paste, switches a text-only model to a Vision Toolkit variant for Q&A, multi-image comparison, long-screenshot OCR, screenshot-to-UI, element grounding, and pixel diff.

Who it is for — You are on a text-only model in DSH Web, cloning a UI or tracing a bug from a screenshot dropped into the session. Skip it if you already stay on vision-capable models and will not drop back to text-only.

Watch out — DeepSeek Harness 0.2.2-rc.1 refuses every published release before install: none declare a DSH range that includes 0.2.2-rc.1. Images default to the author's free host at 100 calls per machine per day, or you point it at your own provider.

The verdict — I'll keep it on the shortlist until the range is widened; I will not pin latest onto 0.2.2-rc.1.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
Details

dsh-browser

omdsh-dev

809

Chrome sidebar extension that lets DeepSeek Harness operate your browser directly, no vision capabilities required. 一款 Chrome 侧边栏扩展程序,可让 DeepSeek Harness 直接操控您的浏览器,无需视觉能力。

Installed cleanly when we ran it

GitHub sourceTypeScript1mo ago

AI review

dsh-browser

What it is — Wires DeepSeek Harness to the Chrome or Firefox tabs you already have open and drives them as numbered, text-only controls.

Who it is for — You are on DeepSeek Harness with a text model like deepseek-v4-flash, working sites you are already logged into—forms, clicks, tab changes—and you need cookies to stay put. If the job only works when the model sees page pixels, this channel will not help: the browser tools never capture screenshots.

Watch out — In the sandbox it installed on a fresh profile and DSH registered it. The usual plugin path is not enough: you run the source installer, load the extension in the browser, and restart DSH if it is already running. The one-liner currently ships the Chrome build, the floor is dsh 0.2.0-rc.2, the installer executes shell, and an API key or token is required. The unscoped npm package dsh-browser is unrelated.

The verdict — The 60-run paired suite is what tips it: same 30/30 as the Playwright baseline, fewer browser tool calls, about 1.35 s less per task—I will eat the extra setup.

Generated by grok-4.6, and a starting point rather than a verdict. Where it says a plugin installs or does not, that is from a real run in a clean profile — everything else is read off the repository. Trust the source over this.Read the source
2Source