litellm - 💡(How to fix) Fix [Bug]: gpt-oss-120b hosted on vllm fails when using websearch interception [1 pull requests]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Error Message

"litellm.NotFoundError: NotFoundError: OpenAIException - The model gpt-oss-120b does not exist."

Fix Action

Fixed

Code Example

model_list:
  - model_name: gpt-oss-120b
    litellm_params:
      model: hosted_vllm/openai/gpt-oss-120b
      api_base: <url>

search_tools:
  - search_tool_name: brave-search
    litellm_params:
      search_provider: brave
      api_key: os.environ/BRAVE_API_KEY

litellm_settings:
  callbacks:
    - websearch_interception
  websearch_interception_params:
    enabled_providers:
      - hosted_vllm
    search_tool_name: brave-search

---

curl -X POST --location '<url>/v1/chat/completions' \
    --header 'Authorization: Bearer <key>' \
    --header 'Content-Type: application/json' \
    --data '{
    "model": "gpt-oss-120b",
    "messages": [
        {
            "role": "user",
            "content": "Find the latest LiteLLM issue about websearch_interception and return the title and URL only."
        }
    ],
    "tools": [
        {
            "type": "function",
            "function": {
                "name": "litellm_web_search"
            }
        }
    ]
}' | jq

---

"litellm.NotFoundError: NotFoundError: OpenAIException - The model `gpt-oss-120b` does not exist."
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

When sending a request to gpt-oss-120b with websearch interception enabled, an error occurs where it attempts to route to the openai provider instead of hosted_vllm. Requests without web search work fine.

Steps to Reproduce

  1. Configure the model and web searching.
model_list:
  - model_name: gpt-oss-120b
    litellm_params:
      model: hosted_vllm/openai/gpt-oss-120b
      api_base: <url>

search_tools:
  - search_tool_name: brave-search
    litellm_params:
      search_provider: brave
      api_key: os.environ/BRAVE_API_KEY

litellm_settings:
  callbacks:
    - websearch_interception
  websearch_interception_params:
    enabled_providers:
      - hosted_vllm
    search_tool_name: brave-search
  1. Send a request.
curl -X POST --location '<url>/v1/chat/completions' \
    --header 'Authorization: Bearer <key>' \
    --header 'Content-Type: application/json' \
    --data '{
    "model": "gpt-oss-120b",
    "messages": [
        {
            "role": "user",
            "content": "Find the latest LiteLLM issue about websearch_interception and return the title and URL only."
        }
    ],
    "tools": [
        {
            "type": "function",
            "function": {
                "name": "litellm_web_search"
            }
        }
    ]
}' | jq
  1. View error logs.

Relevant log output

"litellm.NotFoundError: NotFoundError: OpenAIException - The model `gpt-oss-120b` does not exist."

What part of LiteLLM is this about?

No response

What LiteLLM version are you on ?

v1.83.14

Twitter / LinkedIn details

No response

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING