litellm - 💡(How to fix) Fix AI21 model list outdated — only jamba-large-1.7 and jamba-mini-2 remain [1 comments, 1 participants]

TL;DR

Update the AI21 model list to reflect the current available models and investigate credential binding issues in the Admin UI.

Guidance

• Verify the available AI21 models using the provided curl command to ensure the list is up-to-date.
• Remove deprecated J2 models (j2-light, j2-mid, j2-ultra) from the default model definitions to prevent errors.
• When adding multiple AI21 models via the Admin UI, test credential binding by selecting an existing credential and verifying that the correct API key is applied to each model.
• Consider testing the Admin UI functionality with a fresh credential to isolate the issue.

Example

No code snippet is provided as the issue is more related to configuration and UI interaction.

Notes

The provided curl command can be used to verify the available AI21 models, but it requires a valid API key. The issue with credential binding in the Admin UI may be specific to the implementation and requires further investigation.

Recommendation

Apply workaround: Update the AI21 model list and investigate credential binding issues, as the root cause of the problem seems to be a combination of outdated model information and potential UI bugs.