ollama - 💡(How to fix) Fix Ollama doesn't validate model architecture when importing safetensors [1 participants]

converting model Error: unsupported architecture "MistralForCausalLM"

TL;DR

The issue can likely be resolved by adding support for the "MistralForCausalLM" architecture in the model import process or by checking the architecture before initiating the import.

Guidance

• Verify the list of supported architectures in the config.json file to confirm that "MistralForCausalLM" is not supported.
• Check if there are any existing issues or pull requests related to adding support for the "MistralForCausalLM" architecture.
• Consider implementing a check for unsupported architectures before starting the model import process to prevent orphaned files.
• Review the model import code to understand how it handles unsupported architectures and see if there's a way to add support for "MistralForCausalLM".

Notes

The solution may require modifications to the model import code or the addition of new architecture support, which could involve significant changes.

Recommendation

Apply workaround: Implement a check for unsupported architectures before starting the model import process to prevent orphaned files, as this is a more immediate and less invasive solution than adding support for a new architecture.