ollama - 💡(How to fix) Fix Qwen3.5 MLX models fail to run — config.json not found in manifest [10 comments, 7 participants]

500 Internal Server Error: mlx runner failed: Error: failed to read config.json: config "config.json" not found in manifest (exit: exit status 1)

TL;DR

The issue can likely be resolved by ensuring the config.json file is properly included in the manifest for the Qwen3.5 MLX tags.

Guidance

• Verify that the config.json file exists and is correctly referenced in the manifest for each of the affected tags (qwen3.5:35b-a3b-mlx-bf16, qwen3.5:9b-mlx-bf16, qwen3.5:27b-mlx-bf16).
• Check the manifest files for any discrepancies or errors that might prevent the config.json file from being found.
• Consider re-pulling the tags or re-writing the manifests to ensure consistency and accuracy.
• Investigate the warnings about unable to detect context length for each tag, as this might be related to the issue or indicate a separate problem.

Example

No specific code snippet can be provided without more context on the manifest files or how they are generated.

Notes

The issue seems to be related to the configuration or packaging of the MLX tags rather than the Ollama version or the hardware (GPU, CPU, OS). The warnings about context length detection might be worth exploring further.

Recommendation

Apply a workaround by manually verifying and correcting the manifest files for the affected tags to ensure the config.json file is properly included and referenced. This approach is chosen because it directly addresses the error message provided and allows for a targeted fix without requiring an upgrade or assuming additional issues.