ollama - 💡(How to fix) Fix IQ4/IQ3 GGUF model doesn't support function/tool calling

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Error Message

I serve unsoloth GGUF models with ollama, both codex and vscode copilot are throw no function calling/tools support error, it works fine in openweui. such as https://huggingface.co/unsloth/Qwen3-Coder-Next-GGUF/blob/main/Qwen3-Coder-Next-UD-IQ4_NL.gguf.

RAW_BUFFERClick to expand / collapse

What is the issue?

I serve unsoloth GGUF models with ollama, both codex and vscode copilot are throw no function calling/tools support error, it works fine in openweui. such as https://huggingface.co/unsloth/Qwen3-Coder-Next-GGUF/blob/main/Qwen3-Coder-Next-UD-IQ4_NL.gguf.

Relevant log output

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

extent analysis

TL;DR

  • The issue may be resolved by checking the compatibility of the GGUF models with the ollama, codex, and vscode copilot tools.

Guidance

  • Verify that the GGUF models are correctly formatted and compatible with the tools being used.
  • Check the documentation for ollama, codex, and vscode copilot to ensure that they support the GGUF model format.
  • Test the GGUF models with other tools or environments to isolate the issue.
  • Compare the configuration and setup of openweui, where the models work fine, with the current setup to identify potential differences.

Notes

  • The lack of information about the OS, GPU, CPU, and ollama version may limit the ability to provide a more specific solution.
  • The issue may be related to a specific version or configuration of the tools being used.

Recommendation

  • Apply workaround: Try testing the GGUF models with different tools or environments to isolate the issue and identify a potential workaround.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

ollama - 💡(How to fix) Fix IQ4/IQ3 GGUF model doesn't support function/tool calling