litellm - 💡(How to fix) Fix [Bug]: model_list and models_by_provider have different outputs [1 pull requests]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Fix Action

Fixed

Code Example

import litellm
print(litellm.model_list)
print(litellm.models_by_provider)

---

python -c "import litellm; print([c for c in litellm.model_list if c.startswith('bedrock')])"
['bedrock_mantle/openai.gpt-oss-20b', 'bedrock/moonshotai.kimi-k2.5', 'bedrock_mantle/openai.gpt-oss-safeguard-120b', 'bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0', 'bedrock_mantle/openai.gpt-oss-120b', 'bedrock_mantle/openai.gpt-oss-safeguard-20b', 'bedrock/moonshotai.kimi-k2-thinking']

---

python -c "import litellm; print(litellm.models_by_provider['bedrock'])"
{'stability.stable-fast-upscale-v1:0', 'us.anthropic.claude-3-5-haiku-20241022-v1:0', 'us.meta.llama3-3-70b-instruct-v1:0', 'nvidia.nemotron-nano-12b-v2', 'anthropic.claude-3-opus-20240229-v1:0', 'minimax.minimax-m2', 'global.amazon.nova-2-lite-v1:0', 'eu.anthropic.claude-opus-4-20250514-v1:0', 'us.anthropic.claude-3-haiku-20240307-v1:0', 'au.anthropic.claude-opus-4-6-v1', 'amazon.titan-text-premier-v1:0', 'anthropic.claude-3-7-sonnet-20250219-v1:0', 'eu.meta.llama3-2-3b-instruct-v1:0', 'us.meta.llama3-2-1b-instruct-v1:0', 'stability.stable-image-search-recolor-v1:0', 'mistral.mistral-7b-instruct-v0:2', 'amazon.nova-pro-v1:0', 'meta.llama3-1-8b-instruct-v1:0', 'stability.stable-conservative-upscale-v1:0', '512-x-512/50-steps/stability.stable-diffusion-xl-v0', 'us.amazon.nova-2-lite-v1:0', 'meta.llama3-1-70b-instruct-v1:0', 'ai21.jamba-instruct-v1:0', 'apac.anthropic.claude-3-5-sonnet-20240620-v1:0', 'eu.twelvelabs.marengo-embed-2-7-v1:0', 'stability.stable-image-core-v1:0', 'global.anthropic.claude-sonnet-4-5-20250929-v1:0', 'global.anthropic.claude-sonnet-4-20250514-v1:0', 'meta.llama2-13b-chat-v1', 'stability.stable-creative-upscale-v1:0', 'jp.anthropic.claude-sonnet-4-6', 'jp.anthropic.claude-haiku-4-5-20251001-v1:0', 'eu.deepseek.v3.2', 'global.anthropic.claude-opus-4-7', 'eu.anthropic.claude-3-opus-20240229-v1:0', 'meta.llama3-2-1b-instruct-v1:0', 'anthropic.claude-haiku-4-5-20251001-v1:0', 'us.anthropic.claude-3-opus-20240229-v1:0', 'cohere.embed-v4:0', 'zai.glm-5', 'anthropic.claude-3-5-haiku-20241022-v1:0', 'us.meta.llama3-2-11b-instruct-v1:0', 'global.anthropic.claude-sonnet-4-6', 'meta.llama3-2-90b-instruct-v1:0', 'us.meta.llama3-1-8b-instruct-v1:0', 'eu.anthropic.claude-opus-4-8', 'stability.stable-image-erase-object-v1:0', 'eu.anthropic.claude-opus-4-6-v1', 'eu.anthropic.claude-sonnet-4-6', 'anthropic.claude-opus-4-8', 'global.anthropic.claude-opus-4-8', 'us.writer.palmyra-x5-v1:0', 'mistral.mistral-small-2402-v1:0', 'anthropic.claude-opus-4-20250514-v1:0', 'us.meta.llama4-maverick-17b-instruct-v1:0', 'amazon.nova-2-pro-preview-20251202-v1:0', 'ai21.jamba-1-5-mini-v1:0', 'cohere.embed-english-v3', 'au.anthropic.claude-haiku-4-5-20251001-v1:0', 'mistral.devstral-2-123b', 'us.anthropic.claude-3-5-sonnet-20240620-v1:0', 'qwen.qwen3-32b-v1:0', 'google.gemma-3-12b-it', 'cohere.command-r-v1:0', 'au.anthropic.claude-sonnet-4-6', 'global.anthropic.claude-opus-4-5-20251101-v1:0', 'us.amazon.nova-2-pro-preview-20251202-v1:0', 'eu.anthropic.claude-opus-4-5-20251101-v1:0', 'mistral.magistral-small-2509', 'us.deepseek.r1-v1:0', '1024-x-1024/50-steps/stability.stable-diffusion-xl-v1', 'eu.anthropic.claude-3-haiku-20240307-v1:0', 'anthropic.claude-haiku-4-5@20251001', 'anthropic.claude-3-5-sonnet-20241022-v2:0', 'stability.stable-image-search-replace-v1:0', 'global.anthropic.claude-haiku-4-5-20251001-v1:0', 'meta.llama2-70b-chat-v1', 'us.anthropic.claude-3-sonnet-20240229-v1:0', 'amazon.titan-embed-text-v1', 'us.anthropic.claude-opus-4-8', 'eu.amazon.nova-lite-v1:0', 'us.meta.llama3-1-405b-instruct-v1:0', '1024-x-1024/50-steps/bedrock/amazon.nova-canvas-v1:0', 'eu.anthropic.claude-3-7-sonnet-20250219-v1:0', 'twelvelabs.marengo-embed-2-7-v1:0', 'anthropic.claude-v1', 'stability.stable-image-inpaint-v1:0', 'stability.sd3-large-v1:0', 'eu.mistral.pixtral-large-2502-v1:0', 'cohere.command-text-v14', 'au.anthropic.claude-sonnet-4-5-20250929-v1:0', 'stability.stable-image-ultra-v1:0', 'deepseek.v3.2', 'meta.llama3-70b-instruct-v1:0', 'eu.twelvelabs.pegasus-1-2-v1:0', 'amazon.nova-micro-v1:0', 'us.anthropic.claude-haiku-4-5-20251001-v1:0', 'anthropic.claude-3-7-sonnet-20240620-v1:0', '1024-x-1024/max-steps/stability.stable-diffusion-xl-v1', 'us.amazon.nova-pro-v1:0', 'anthropic.claude-mythos-preview', 'bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0', 'stability.stable-image-ultra-v1:1', 'apac.anthropic.claude-sonnet-4-20250514-v1:0', 'us.anthropic.claude-opus-4-7', 'nvidia.nemotron-super-3-120b', 'max-x-max/50-steps/stability.stable-diffusion-xl-v0', 'eu.anthropic.claude-3-sonnet-20240229-v1:0', 'eu.amazon.nova-2-pro-preview-20251202-v1:0', 'zai.glm-4.7-flash', 'qwen.qwen3-next-80b-a3b', 'openai.gpt-oss-120b-1:0', 'jp.anthropic.claude-sonnet-4-5-20250929-v1:0', 'anthropic.claude-opus-4-7', 'us.anthropic.claude-opus-4-1-20250805-v1:0', 'amazon.nova-canvas-v1:0', 'meta.llama3-2-11b-instruct-v1:0', 'twelvelabs.pegasus-1-2-v1:0', 'bedrock/moonshotai.kimi-k2.5', 'eu.amazon.nova-2-lite-v1:0', 'apac.anthropic.claude-3-5-sonnet-20241022-v2:0', 'google.gemma-3-27b-it', 'us.meta.llama4-scout-17b-instruct-v1:0', 'apac.anthropic.claude-3-sonnet-20240229-v1:0', 'apac.anthropic.claude-3-haiku-20240307-v1:0', 'eu.anthropic.claude-3-5-haiku-20241022-v1:0', 'qwen.qwen3-vl-235b-a22b', 'qwen.qwen3-coder-480b-a35b-v1:0', 'us.anthropic.claude-sonnet-4-5-20250929-v1:0', 'us.amazon.nova-canvas-v1:0', 'au.anthropic.claude-opus-4-8', 'anthropic.claude-opus-4-6-v1:0', 'anthropic.claude-3-sonnet-20240229-v1:0', 'anthropic.claude-instant-v1', 'meta.llama4-maverick-17b-instruct-v1:0', 'minimax.minimax-m2.5', 'stability.stable-style-transfer-v1:0', 'mistral.mistral-large-2407-v1:0', 'eu.meta.llama3-2-1b-instruct-v1:0', 'us.anthropic.claude-opus-4-6-v1', 'anthropic.claude-3-haiku-20240307-v1:0', 'mistral.mixtral-8x7b-instruct-v0:1', 'us.anthropic.claude-3-7-sonnet-20250219-v1:0', 'stability.stable-image-remove-background-v1:0', 'anthropic.claude-opus-4-1-20250805-v1:0', 'global.anthropic.claude-opus-4-6-v1', 'apac.amazon.nova-micro-v1:0', 'eu.anthropic.claude-3-5-sonnet-20241022-v2:0', 'stability.stable-image-style-guide-v1:0', 'au.anthropic.claude-opus-4-7', 'openai.gpt-oss-safeguard-20b', 'anthropic.claude-v2', 'amazon.nova-lite-v1:0', 'anthropic.claude-sonnet-4-20250514-v1:0', 'mistral.ministral-3-14b-instruct', 'us.meta.llama3-2-3b-instruct-v1:0', 'amazon.rerank-v1:0', 'meta.llama4-scout-17b-instruct-v1:0', 'meta.llama3-3-70b-instruct-v1:0', 'stability.stable-image-control-structure-v1:0', 'us.anthropic.claude-sonnet-4-6', 'eu.anthropic.claude-haiku-4-5-20251001-v1:0', 'stability.stable-image-core-v1:1', 'amazon.titan-text-lite-v1', 'amazon.nova-2-multimodal-embeddings-v1:0', 'mistral.voxtral-mini-3b-2507', 'us.mistral.pixtral-large-2502-v1:0', 'cohere.rerank-v3-5:0', 'cohere.command-light-text-v14', 'amazon.titan-image-generator-v2:0', 'stability.sd3-5-large-v1:0', '512-x-512/max-steps/stability.stable-diffusion-xl-v0', 'amazon.titan-image-generator-v2', 'qwen.qwen3-coder-30b-a3b-v1:0', 'eu.anthropic.claude-sonnet-4-5-20250929-v1:0', 'stability.stable-outpaint-v1:0', 'writer.palmyra-x5-v1:0', 'us.meta.llama3-2-90b-instruct-v1:0', 'cohere.embed-multilingual-v3', 'eu.anthropic.claude-3-5-sonnet-20240620-v1:0', 'apac.anthropic.claude-haiku-4-5-20251001-v1:0', 'eu.anthropic.claude-opus-4-7', 'apac.amazon.nova-2-lite-v1:0', 'eu.amazon.nova-pro-v1:0', 'amazon.nova-2-lite-v1:0', 'mistral.ministral-3-8b-instruct', 'us.amazon.nova-lite-v1:0', 'us-gov.anthropic.claude-sonnet-4-5-20250929-v1:0', 'openai.gpt-oss-20b-1:0', 'mistral.voxtral-small-24b-2507', 'qwen.qwen3-coder-next', 'moonshotai.kimi-k2.5', 'us.amazon.nova-micro-v1:0', 'stability.stable-image-control-sketch-v1:0', 'ai21.j2-mid-v1', 'anthropic.claude-sonnet-4-6', 'moonshot.kimi-k2-thinking', 'qwen.qwen3-235b-a22b-2507-v1:0', 'amazon.titan-embed-text-v2:0', 'max-x-max/max-steps/stability.stable-diffusion-xl-v0', 'apac.amazon.nova-2-pro-preview-20251202-v1:0', 'bedrock/moonshotai.kimi-k2-thinking', 'zai.glm-4.7', 'openai.gpt-oss-safeguard-120b', 'ai21.j2-ultra-v1', 'amazon.titan-embed-image-v1', 'cohere.command-r-plus-v1:0', 'nvidia.nemotron-nano-3-30b', 'meta.llama3-1-405b-instruct-v1:0', 'anthropic.claude-v2:1', 'anthropic.claude-sonnet-4-5-20250929-v1:0', 'deepseek.v3-v1:0', 'writer.palmyra-x4-v1:0', 'amazon.titan-image-generator-v1', 'us.writer.palmyra-x4-v1:0', 'us.anthropic.claude-opus-4-5-20251101-v1:0', 'anthropic.claude-opus-4-6-v1', 'meta.llama3-2-3b-instruct-v1:0', 'claude-sonnet-4-5-20250929-v1:0', 'us.amazon.nova-premier-v1:0', 'meta.llama3-8b-instruct-v1:0', 'amazon.titan-text-express-v1', 'eu.anthropic.claude-sonnet-4-20250514-v1:0', 'mistral.mistral-large-2402-v1:0', 'us.twelvelabs.pegasus-1-2-v1:0', 'anthropic.claude-opus-4-5-20251101-v1:0', 'apac.amazon.nova-lite-v1:0', 'mistral.mistral-large-3-675b-instruct', 'ai21.jamba-1-5-large-v1:0', 'apac.amazon.nova-pro-v1:0', 'us.meta.llama3-1-70b-instruct-v1:0', 'us.twelvelabs.marengo-embed-2-7-v1:0', 'us.anthropic.claude-opus-4-20250514-v1:0', 'us.deepseek.v3.2', 'minimax.minimax-m2.1', 'google.gemma-3-4b-it', 'eu.anthropic.claude-opus-4-1-20250805-v1:0', 'nvidia.nemotron-nano-9b-v2', 'us.anthropic.claude-sonnet-4-20250514-v1:0', 'us.anthropic.claude-3-5-sonnet-20241022-v2:0', 'eu.amazon.nova-micro-v1:0', 'mistral.ministral-3-3b-instruct', 'anthropic.claude-3-5-sonnet-20240620-v1:0'}

---
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

It seems that:

import litellm
print(litellm.model_list)
print(litellm.models_by_provider)

output very different results, with the latter models_by_provider having all the models listed in https://models.litellm.ai/; and model_list missing a lot of models.

Steps to Reproduce

For instance:

python -c "import litellm; print([c for c in litellm.model_list if c.startswith('bedrock')])"
['bedrock_mantle/openai.gpt-oss-20b', 'bedrock/moonshotai.kimi-k2.5', 'bedrock_mantle/openai.gpt-oss-safeguard-120b', 'bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0', 'bedrock_mantle/openai.gpt-oss-120b', 'bedrock_mantle/openai.gpt-oss-safeguard-20b', 'bedrock/moonshotai.kimi-k2-thinking']

compared to:

python -c "import litellm; print(litellm.models_by_provider['bedrock'])"
{'stability.stable-fast-upscale-v1:0', 'us.anthropic.claude-3-5-haiku-20241022-v1:0', 'us.meta.llama3-3-70b-instruct-v1:0', 'nvidia.nemotron-nano-12b-v2', 'anthropic.claude-3-opus-20240229-v1:0', 'minimax.minimax-m2', 'global.amazon.nova-2-lite-v1:0', 'eu.anthropic.claude-opus-4-20250514-v1:0', 'us.anthropic.claude-3-haiku-20240307-v1:0', 'au.anthropic.claude-opus-4-6-v1', 'amazon.titan-text-premier-v1:0', 'anthropic.claude-3-7-sonnet-20250219-v1:0', 'eu.meta.llama3-2-3b-instruct-v1:0', 'us.meta.llama3-2-1b-instruct-v1:0', 'stability.stable-image-search-recolor-v1:0', 'mistral.mistral-7b-instruct-v0:2', 'amazon.nova-pro-v1:0', 'meta.llama3-1-8b-instruct-v1:0', 'stability.stable-conservative-upscale-v1:0', '512-x-512/50-steps/stability.stable-diffusion-xl-v0', 'us.amazon.nova-2-lite-v1:0', 'meta.llama3-1-70b-instruct-v1:0', 'ai21.jamba-instruct-v1:0', 'apac.anthropic.claude-3-5-sonnet-20240620-v1:0', 'eu.twelvelabs.marengo-embed-2-7-v1:0', 'stability.stable-image-core-v1:0', 'global.anthropic.claude-sonnet-4-5-20250929-v1:0', 'global.anthropic.claude-sonnet-4-20250514-v1:0', 'meta.llama2-13b-chat-v1', 'stability.stable-creative-upscale-v1:0', 'jp.anthropic.claude-sonnet-4-6', 'jp.anthropic.claude-haiku-4-5-20251001-v1:0', 'eu.deepseek.v3.2', 'global.anthropic.claude-opus-4-7', 'eu.anthropic.claude-3-opus-20240229-v1:0', 'meta.llama3-2-1b-instruct-v1:0', 'anthropic.claude-haiku-4-5-20251001-v1:0', 'us.anthropic.claude-3-opus-20240229-v1:0', 'cohere.embed-v4:0', 'zai.glm-5', 'anthropic.claude-3-5-haiku-20241022-v1:0', 'us.meta.llama3-2-11b-instruct-v1:0', 'global.anthropic.claude-sonnet-4-6', 'meta.llama3-2-90b-instruct-v1:0', 'us.meta.llama3-1-8b-instruct-v1:0', 'eu.anthropic.claude-opus-4-8', 'stability.stable-image-erase-object-v1:0', 'eu.anthropic.claude-opus-4-6-v1', 'eu.anthropic.claude-sonnet-4-6', 'anthropic.claude-opus-4-8', 'global.anthropic.claude-opus-4-8', 'us.writer.palmyra-x5-v1:0', 'mistral.mistral-small-2402-v1:0', 'anthropic.claude-opus-4-20250514-v1:0', 'us.meta.llama4-maverick-17b-instruct-v1:0', 'amazon.nova-2-pro-preview-20251202-v1:0', 'ai21.jamba-1-5-mini-v1:0', 'cohere.embed-english-v3', 'au.anthropic.claude-haiku-4-5-20251001-v1:0', 'mistral.devstral-2-123b', 'us.anthropic.claude-3-5-sonnet-20240620-v1:0', 'qwen.qwen3-32b-v1:0', 'google.gemma-3-12b-it', 'cohere.command-r-v1:0', 'au.anthropic.claude-sonnet-4-6', 'global.anthropic.claude-opus-4-5-20251101-v1:0', 'us.amazon.nova-2-pro-preview-20251202-v1:0', 'eu.anthropic.claude-opus-4-5-20251101-v1:0', 'mistral.magistral-small-2509', 'us.deepseek.r1-v1:0', '1024-x-1024/50-steps/stability.stable-diffusion-xl-v1', 'eu.anthropic.claude-3-haiku-20240307-v1:0', 'anthropic.claude-haiku-4-5@20251001', 'anthropic.claude-3-5-sonnet-20241022-v2:0', 'stability.stable-image-search-replace-v1:0', 'global.anthropic.claude-haiku-4-5-20251001-v1:0', 'meta.llama2-70b-chat-v1', 'us.anthropic.claude-3-sonnet-20240229-v1:0', 'amazon.titan-embed-text-v1', 'us.anthropic.claude-opus-4-8', 'eu.amazon.nova-lite-v1:0', 'us.meta.llama3-1-405b-instruct-v1:0', '1024-x-1024/50-steps/bedrock/amazon.nova-canvas-v1:0', 'eu.anthropic.claude-3-7-sonnet-20250219-v1:0', 'twelvelabs.marengo-embed-2-7-v1:0', 'anthropic.claude-v1', 'stability.stable-image-inpaint-v1:0', 'stability.sd3-large-v1:0', 'eu.mistral.pixtral-large-2502-v1:0', 'cohere.command-text-v14', 'au.anthropic.claude-sonnet-4-5-20250929-v1:0', 'stability.stable-image-ultra-v1:0', 'deepseek.v3.2', 'meta.llama3-70b-instruct-v1:0', 'eu.twelvelabs.pegasus-1-2-v1:0', 'amazon.nova-micro-v1:0', 'us.anthropic.claude-haiku-4-5-20251001-v1:0', 'anthropic.claude-3-7-sonnet-20240620-v1:0', '1024-x-1024/max-steps/stability.stable-diffusion-xl-v1', 'us.amazon.nova-pro-v1:0', 'anthropic.claude-mythos-preview', 'bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0', 'stability.stable-image-ultra-v1:1', 'apac.anthropic.claude-sonnet-4-20250514-v1:0', 'us.anthropic.claude-opus-4-7', 'nvidia.nemotron-super-3-120b', 'max-x-max/50-steps/stability.stable-diffusion-xl-v0', 'eu.anthropic.claude-3-sonnet-20240229-v1:0', 'eu.amazon.nova-2-pro-preview-20251202-v1:0', 'zai.glm-4.7-flash', 'qwen.qwen3-next-80b-a3b', 'openai.gpt-oss-120b-1:0', 'jp.anthropic.claude-sonnet-4-5-20250929-v1:0', 'anthropic.claude-opus-4-7', 'us.anthropic.claude-opus-4-1-20250805-v1:0', 'amazon.nova-canvas-v1:0', 'meta.llama3-2-11b-instruct-v1:0', 'twelvelabs.pegasus-1-2-v1:0', 'bedrock/moonshotai.kimi-k2.5', 'eu.amazon.nova-2-lite-v1:0', 'apac.anthropic.claude-3-5-sonnet-20241022-v2:0', 'google.gemma-3-27b-it', 'us.meta.llama4-scout-17b-instruct-v1:0', 'apac.anthropic.claude-3-sonnet-20240229-v1:0', 'apac.anthropic.claude-3-haiku-20240307-v1:0', 'eu.anthropic.claude-3-5-haiku-20241022-v1:0', 'qwen.qwen3-vl-235b-a22b', 'qwen.qwen3-coder-480b-a35b-v1:0', 'us.anthropic.claude-sonnet-4-5-20250929-v1:0', 'us.amazon.nova-canvas-v1:0', 'au.anthropic.claude-opus-4-8', 'anthropic.claude-opus-4-6-v1:0', 'anthropic.claude-3-sonnet-20240229-v1:0', 'anthropic.claude-instant-v1', 'meta.llama4-maverick-17b-instruct-v1:0', 'minimax.minimax-m2.5', 'stability.stable-style-transfer-v1:0', 'mistral.mistral-large-2407-v1:0', 'eu.meta.llama3-2-1b-instruct-v1:0', 'us.anthropic.claude-opus-4-6-v1', 'anthropic.claude-3-haiku-20240307-v1:0', 'mistral.mixtral-8x7b-instruct-v0:1', 'us.anthropic.claude-3-7-sonnet-20250219-v1:0', 'stability.stable-image-remove-background-v1:0', 'anthropic.claude-opus-4-1-20250805-v1:0', 'global.anthropic.claude-opus-4-6-v1', 'apac.amazon.nova-micro-v1:0', 'eu.anthropic.claude-3-5-sonnet-20241022-v2:0', 'stability.stable-image-style-guide-v1:0', 'au.anthropic.claude-opus-4-7', 'openai.gpt-oss-safeguard-20b', 'anthropic.claude-v2', 'amazon.nova-lite-v1:0', 'anthropic.claude-sonnet-4-20250514-v1:0', 'mistral.ministral-3-14b-instruct', 'us.meta.llama3-2-3b-instruct-v1:0', 'amazon.rerank-v1:0', 'meta.llama4-scout-17b-instruct-v1:0', 'meta.llama3-3-70b-instruct-v1:0', 'stability.stable-image-control-structure-v1:0', 'us.anthropic.claude-sonnet-4-6', 'eu.anthropic.claude-haiku-4-5-20251001-v1:0', 'stability.stable-image-core-v1:1', 'amazon.titan-text-lite-v1', 'amazon.nova-2-multimodal-embeddings-v1:0', 'mistral.voxtral-mini-3b-2507', 'us.mistral.pixtral-large-2502-v1:0', 'cohere.rerank-v3-5:0', 'cohere.command-light-text-v14', 'amazon.titan-image-generator-v2:0', 'stability.sd3-5-large-v1:0', '512-x-512/max-steps/stability.stable-diffusion-xl-v0', 'amazon.titan-image-generator-v2', 'qwen.qwen3-coder-30b-a3b-v1:0', 'eu.anthropic.claude-sonnet-4-5-20250929-v1:0', 'stability.stable-outpaint-v1:0', 'writer.palmyra-x5-v1:0', 'us.meta.llama3-2-90b-instruct-v1:0', 'cohere.embed-multilingual-v3', 'eu.anthropic.claude-3-5-sonnet-20240620-v1:0', 'apac.anthropic.claude-haiku-4-5-20251001-v1:0', 'eu.anthropic.claude-opus-4-7', 'apac.amazon.nova-2-lite-v1:0', 'eu.amazon.nova-pro-v1:0', 'amazon.nova-2-lite-v1:0', 'mistral.ministral-3-8b-instruct', 'us.amazon.nova-lite-v1:0', 'us-gov.anthropic.claude-sonnet-4-5-20250929-v1:0', 'openai.gpt-oss-20b-1:0', 'mistral.voxtral-small-24b-2507', 'qwen.qwen3-coder-next', 'moonshotai.kimi-k2.5', 'us.amazon.nova-micro-v1:0', 'stability.stable-image-control-sketch-v1:0', 'ai21.j2-mid-v1', 'anthropic.claude-sonnet-4-6', 'moonshot.kimi-k2-thinking', 'qwen.qwen3-235b-a22b-2507-v1:0', 'amazon.titan-embed-text-v2:0', 'max-x-max/max-steps/stability.stable-diffusion-xl-v0', 'apac.amazon.nova-2-pro-preview-20251202-v1:0', 'bedrock/moonshotai.kimi-k2-thinking', 'zai.glm-4.7', 'openai.gpt-oss-safeguard-120b', 'ai21.j2-ultra-v1', 'amazon.titan-embed-image-v1', 'cohere.command-r-plus-v1:0', 'nvidia.nemotron-nano-3-30b', 'meta.llama3-1-405b-instruct-v1:0', 'anthropic.claude-v2:1', 'anthropic.claude-sonnet-4-5-20250929-v1:0', 'deepseek.v3-v1:0', 'writer.palmyra-x4-v1:0', 'amazon.titan-image-generator-v1', 'us.writer.palmyra-x4-v1:0', 'us.anthropic.claude-opus-4-5-20251101-v1:0', 'anthropic.claude-opus-4-6-v1', 'meta.llama3-2-3b-instruct-v1:0', 'claude-sonnet-4-5-20250929-v1:0', 'us.amazon.nova-premier-v1:0', 'meta.llama3-8b-instruct-v1:0', 'amazon.titan-text-express-v1', 'eu.anthropic.claude-sonnet-4-20250514-v1:0', 'mistral.mistral-large-2402-v1:0', 'us.twelvelabs.pegasus-1-2-v1:0', 'anthropic.claude-opus-4-5-20251101-v1:0', 'apac.amazon.nova-lite-v1:0', 'mistral.mistral-large-3-675b-instruct', 'ai21.jamba-1-5-large-v1:0', 'apac.amazon.nova-pro-v1:0', 'us.meta.llama3-1-70b-instruct-v1:0', 'us.twelvelabs.marengo-embed-2-7-v1:0', 'us.anthropic.claude-opus-4-20250514-v1:0', 'us.deepseek.v3.2', 'minimax.minimax-m2.1', 'google.gemma-3-4b-it', 'eu.anthropic.claude-opus-4-1-20250805-v1:0', 'nvidia.nemotron-nano-9b-v2', 'us.anthropic.claude-sonnet-4-20250514-v1:0', 'us.anthropic.claude-3-5-sonnet-20241022-v2:0', 'eu.amazon.nova-micro-v1:0', 'mistral.ministral-3-3b-instruct', 'anthropic.claude-3-5-sonnet-20240620-v1:0'}

Relevant log output

What part of LiteLLM is this about?

SDK (litellm Python package)

What LiteLLM version are you on ?

v1.86.2

Twitter / LinkedIn details

No response

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

litellm - 💡(How to fix) Fix [Bug]: model_list and models_by_provider have different outputs [1 pull requests]