ollama - 💡(How to fix) Fix "error":"mlx runner failed: Error: failed to create server [1 participants]

{"error":"mlx runner failed: Error: failed to create server: failed to load image model: failed to load zimage model: text encoder: load weights: load model.layers.15.self_attn.q_proj.weight_qbias: failed to load safetensors: /root/public-storage/ollama/blobs/sha256-08648aed190bcdacb8fb525e8316198ce2dd40505fcec3b9fc1d77caa0f6cf04 (exit: exit status 1)"}

TL;DR

The issue is likely due to a failure in loading the model weights, and checking the file path and permissions of the model file /root/public-storage/ollama/blobs/sha256-08648aed190bcdacb8fb525e8316198ce2dd40505fcec3b9fc1d77caa0f6cf04 may resolve the issue.

Guidance

• Verify that the file /root/public-storage/ollama/blobs/sha256-08648aed190bcdacb8fb525e8316198ce2dd40505fcec3b9fc1d77caa0f6cf04 exists and is accessible by the process running the command.
• Check the file permissions and ownership to ensure that the process has read access to the file.
• Confirm that the model file is not corrupted and can be loaded correctly by checking the file integrity and trying to load it manually.
• Consider updating the Ollama version to a newer release, if available, to ensure that any known issues with model loading are addressed.

Example

No code snippet is provided as it is not necessary for this issue.

Notes

The issue seems to be related to the loading of model weights, and resolving the file access issue may fix the problem. However, without more information about the Ollama version and the model file, it is difficult to provide a more specific solution.

Recommendation

Apply workaround: Check and fix the file path and permissions of the model file, as this is the most likely cause of the issue.