litellm - 💡(How to fix) Fix i can not get models [1 participants]

TL;DR

• Verify the model names in the LITELLM_MODEL_LIST environment variable match the actual model names supported by LiteLLM.

Guidance

• Check the LiteLLM documentation for the correct model names and their corresponding parameters.
• Ensure the model_name and litellm_params fields in the LITELLM_MODEL_LIST JSON string are correctly formatted and match the expected input for LiteLLM.
• Test loading a single model with a known correct name to isolate the issue.

Notes

• The issue may be due to a mismatch between the model names provided in the environment variable and the actual names recognized by LiteLLM.
• Without access to the LiteLLM documentation or a list of supported models, it's difficult to provide a more specific solution.

Recommendation

• Apply workaround: Verify and correct the model names in the LITELLM_MODEL_LIST environment variable to match the actual names supported by LiteLLM, as this is likely to resolve the issue with loading models.