Issue Station
Sign In
Tools hereToolbox

litellm - 💡(How to fix) Fix [Bug]: Failed to call /v1/messages with Non-Anthropic Models [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
BerriAI/litellm#26697•Fetched 2026-04-29 06:12:45
View on GitHub
Comments
0
Participants
1
Timeline
3
Reactions
0
Author
FuyubaiFuyubai
Participants
FuyubaiFuyubai
Timeline (top)
labeled ×3

Error Message

POST Request Sent from LiteLLM: curl -X POST
http://IP:PORT/v1/responses
-H 'Authorization: Be****h7'
-d '{'model': 'Qwen3-32B', 'input': [{'type': 'message', 'role': 'user', 'content': [{'type': 'input_text', 'text': 'Hello, can you tell me a short joke?'}]}], 'max_output_tokens': 100}'

litellm.exceptions.NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - {"detail":"Not Found"}.

Code Example

model_list:
  - model_name: Qwen3-32B
    litellm_params:
      model: openai/Qwen3-32B
      api_base: "http://ip:port/v1"
      api_key: "sk-xx"

---

litellm                            1.82.3
litellm-enterprise                 0.1.39
litellm-proxy-extras               0.4.69

---

POST Request Sent from LiteLLM:
curl -X POST \
http://IP:PORT/v1/responses \
-H 'Authorization: Be****h7' \
-d '{'model': 'Qwen3-32B', 'input': [{'type': 'message', 'role': 'user', 'content': [{'type': 'input_text', 'text': 'Hello, can you tell me a short joke?'}]}], 'max_output_tokens': 100}'

litellm.exceptions.NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - {"detail":"Not Found"}.
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

I want to proxy a local openai-style model with litellm, and i want to call this model with antrophic-style, i.e. /v1/messages

Normally, litellm should translate /v1/messages to /v1/chat/completions, but litellm seems to do nothing in translating between them, and i receive a error {"detail":"Not Found"}

Steps to Reproduce

LiteLLM Configuration File

model_list:
  - model_name: Qwen3-32B
    litellm_params:
      model: openai/Qwen3-32B
      api_base: "http://ip:port/v1"
      api_key: "sk-xx"

Initialization Command litellm --config config.yaml --detailed_debug

LiteLLM Version

litellm                            1.82.3
litellm-enterprise                 0.1.39
litellm-proxy-extras               0.4.69

Relevant log output

POST Request Sent from LiteLLM:
curl -X POST \
http://IP:PORT/v1/responses \
-H 'Authorization: Be****h7' \
-d '{'model': 'Qwen3-32B', 'input': [{'type': 'message', 'role': 'user', 'content': [{'type': 'input_text', 'text': 'Hello, can you tell me a short joke?'}]}], 'max_output_tokens': 100}'

litellm.exceptions.NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - {"detail":"Not Found"}.

What part of LiteLLM is this about?

Proxy

What LiteLLM version are you on ?

1.82.3

Twitter / LinkedIn details

No response

extent analysis

TL;DR

Verify that the api_base URL in the LiteLLM configuration file is correctly set to handle the /v1/messages endpoint.

Guidance

  • Check the LiteLLM documentation to ensure that the api_base URL is correctly configured to translate /v1/messages to /v1/chat/completions.
  • Review the LiteLLM configuration file to confirm that the model_name and litellm_params are correctly set for the Qwen3-32B model.
  • Verify that the api_key is valid and correctly formatted.
  • Test the LiteLLM proxy with a different endpoint to isolate the issue.

Example

No code example is provided as the issue seems to be related to configuration rather than code.

Notes

The issue may be related to a misconfiguration of the LiteLLM proxy or an incompatibility between the LiteLLM version and the OpenAI model.

Recommendation

Apply workaround: Verify the api_base URL and adjust the configuration file as needed to ensure correct translation of endpoints.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#API routing#API middleware#SSR setup#ISR setup

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

litellm - 💡(How to fix) Fix [Bug]: Failed to call /v1/messages with Non-Anthropic Models [1 participants]