openclaw - ✅(Solved) Fix [Bug]: Ollama vision models not accessible via `image` tool [1 pull requests, 1 comments, 2 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
openclaw/openclaw#64111Fetched 2026-04-11 06:16:21
View on GitHub
Comments
1
Participants
2
Timeline
5
Reactions
0
Timeline (top)
labeled ×2commented ×1cross-referenced ×1referenced ×1

image tool cannot use Ollama vision models despite correct configuration and confirmed vision capability

Error Message

  1. Observe error: "No API provider registered for api: ollama" Error: "All image models failed: ollama/gemma4:e4b: No API provider registered for api: ollama". Ollama chat (text) works fine with the same configuration.

Root Cause

Root cause: The Ollama plugin (openclaw.plugin.json) registers these contracts:

  • memoryEmbeddingProviders: ["ollama"]
  • webSearchProviders: ["ollama"] It does NOT register any image or mediaUnderstanding contract. The image tool uses a separate provider lookup path that doesn't find Ollama. Workaround: using doubao-vision-ocr skill as a temporary alternative.

Fix Action

Fix / Workaround

Root cause: The Ollama plugin (openclaw.plugin.json) registers these contracts:

  • memoryEmbeddingProviders: ["ollama"]
  • webSearchProviders: ["ollama"] It does NOT register any image or mediaUnderstanding contract. The image tool uses a separate provider lookup path that doesn't find Ollama. Workaround: using doubao-vision-ocr skill as a temporary alternative.

PR fix notes

PR #64146: fix(ollama): register mediaUnderstandingProviders contract for vision models

Description (problem / solution / changelog)

Summary

Ollama plugin only registered and contracts, missing the contract. This caused the image tool's provider lookup to fail for Ollama vision models (e.g. gemma4:e4b), even though Ollama's /api/chat natively supports vision.

Fix

Add to the plugin contracts in , consistent with all other vision-capable plugins (openai, anthropic, google, etc.).

Testing

  • Verified the plugin manifest schema already supports (src/plugins/manifest.ts:142)
  • No code logic changes required — the provider lookup path already looks for this contract
  • Manual verification: after this change, tool with should route correctly

Fixes #64111

Changed files

  • extensions/ollama/openclaw.plugin.json (modified, +2/-1)
RAW_BUFFERClick to expand / collapse

Bug type

Regression (worked before, now fails)

Beta release blocker

No

Summary

image tool cannot use Ollama vision models despite correct configuration and confirmed vision capability

Steps to reproduce

  1. Configure Ollama provider with a vision-capable model (e.g., gemma4:e4b) in openclaw.json
  2. Set agents.defaults.imageModel.primary to "ollama/gemma4:e4b"
  3. Enable the Ollama plugin
  4. Attempt to analyze an image using the image tool
  5. Observe error: "No API provider registered for api: ollama"

Expected behavior

image tool should route to ollama/gemma4:e4b and successfully analyze images, since Ollama's native /api/chat supports vision models

Actual behavior

Error: "All image models failed: ollama/gemma4:e4b: No API provider registered for api: ollama". Ollama chat (text) works fine with the same configuration.

OpenClaw version

2026.4.9

Operating system

Windows 11

Install method

npm global

Model

ollama/gemma4:e4b

Provider / routing chain

openclaw -> ollama (local, http://localhost:11434)

Additional provider/model setup details

Ollama plugin is enabled and working for text chat. The model gemma4:e4b has confirmed vision capability via /api/show (capabilities: ["completion", "vision", "audio", "tools"]). The Ollama plugin contracts only register memoryEmbeddingProviders and webSearchProviders, NOT image or mediaUnderstanding contracts.

Logs, screenshots, and evidence

Impact and severity

Affected: Users who want to use local Ollama vision models for image analysis Severity: Medium (blocks use of local vision models, forces use of external API) Frequency: Always (100% reproducible) Consequence: Cannot use gemma4:e4b or other Ollama vision models via image tool despite correct setup

Additional information

Root cause: The Ollama plugin (openclaw.plugin.json) registers these contracts:

  • memoryEmbeddingProviders: ["ollama"]
  • webSearchProviders: ["ollama"] It does NOT register any image or mediaUnderstanding contract. The image tool uses a separate provider lookup path that doesn't find Ollama. Workaround: using doubao-vision-ocr skill as a temporary alternative.

extent analysis

TL;DR

The Ollama plugin needs to register an image or mediaUnderstanding contract to enable the image tool to use Ollama vision models.

Guidance

  • Verify that the Ollama plugin's openclaw.plugin.json file only registers memoryEmbeddingProviders and webSearchProviders, but not image or mediaUnderstanding contracts.
  • Check the image tool's provider lookup path to confirm it doesn't find Ollama due to the missing contract registration.
  • Consider registering the necessary contract in the Ollama plugin to enable image analysis with Ollama vision models.
  • As a temporary workaround, use the doubao-vision-ocr skill for image analysis.

Example

No code snippet is provided as the issue doesn't imply a specific code change, but rather a configuration or plugin registration issue.

Notes

The root cause of the issue seems to be the missing registration of the image or mediaUnderstanding contract in the Ollama plugin. The provided workaround using the doubao-vision-ocr skill may not be a permanent solution, but it can help mitigate the issue temporarily.

Recommendation

Apply workaround: Use the doubao-vision-ocr skill as a temporary alternative until the Ollama plugin is updated to register the necessary contract for image analysis.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

FAQ

Expected behavior

image tool should route to ollama/gemma4:e4b and successfully analyze images, since Ollama's native /api/chat supports vision models

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING