Open-source NVIDIA Vision MCP for ZCode / GLM #258
cyril-belin
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
NVIDIA Vision MCP for ZCode / GLM
Hi ZCode team,
I’ve been testing ZCode/GLM on a real Flutter UI reproduction workflow using reference screenshots.
One limitation I ran into is that the coding model itself does not always have native image understanding available in the workflow. I initially tested Gemini Vision through MCP, but eventually hit quota limits.
So I built a small open-source MCP server that gives ZCode access to vision models through NVIDIA NIM:
https://github.com/cyril-belin/nvidia-vision-mcp
What it does
It exposes a simple MCP tool:
analyze_imagewith support for:
image_pathfor local stdio usageimage_urlimage_base64The current default model is:
minimaxai/minimax-m3through NVIDIA NIM.
Why I built it
The interesting part for me was not only making vision available, but seeing how ZCode actually used it during an autonomous coding loop.
In my Flutter test, ZCode was able to:
I did not need to manually prompt it after every visual correction.
That made MCP-based vision a surprisingly effective workaround for models/workflows without native image input.
Rate limiting
During testing, NVIDIA free endpoints occasionally returned HTTP 429.
The MCP therefore includes:
Retry-AfterhandlingThis was tested against real NVIDIA throttling.
Open source
The repository is MIT licensed and designed so every user supplies their own NVIDIA API key.
It can run locally with ZCode or be self-hosted remotely.
Repository:
https://github.com/cyril-belin/nvidia-vision-mcp
I’m sharing it here mainly because it may be useful to other ZCode users working with UI screenshots, visual QA, or image-based coding workflows.
I’d also be interested to know whether native image/vision support is planned directly inside ZCode/GLM workflows in the future.
All reactions