ollama - 💡(How to fix) Fix quwen3-next:80b failed to load 500 server error on ollama v0.17.7 [1 comments, 2 participants]

quwen3-next:80b failed to load 500 server error on ollama v0.17.7 500 Internal Server Error: failed to initialize model: qwen3next: layer 0 missing attn_qkv/attn_gate projections

Fix Plan

The fix involves updating the model configuration to include the missing attn_qkv and attn_gate projections for the qwen3-next:80b model.

Step-by-Step Solution

• Update the ollama configuration file to include the missing projections:

model_config = {
    'qwen3-next:80b': {
        'layer_0': {
            'attn_qkv': True,
            'attn_gate': True
        }
    }
}

• Alternatively, you can try downgrading to ollama version v0.17.0 which is reported to work with the qwen3-next:80b model.
• If you are using a config.json file, update it with the following:

{
    "models": {
        "qwen3-next:80b": {
            "layer_0": {
                "attn_qkv": true,
                "attn_gate": true
            }
        }
    }
}

Verification

To verify that the fix worked, restart the ollama server and try loading the qwen3-next:80b model again. If the model loads successfully, the fix was successful.

Extra Tips

• Make sure to update the ollama configuration file correctly to avoid any syntax errors.
• If you are still experiencing issues, try checking the ollama documentation for any specific requirements for the qwen3-next:80b model.