litellm - 💡(How to fix) Fix Validate if web_search is supported with structured_output [1 participants]

ParsedResponse(id=<redacted>, created_at=<redacted>, error=None, incomplete_details=None, instructions=None, metadata={}, model='gpt-5.4', object='response', output=[ParsedResponseOutputMessage(id=<redacted>, content=[ParsedResponseOutputText[<redacted>], parallel_tool_calls=True, temperature=0.0, tool_choice='auto', tools=[WebSearchTool(type='web_search_preview', search_context_size='high', user_location=UserLocation(type='approximate', city=None, country='US', region=None, timezone=None))], top_p=0.98, background=False, max_output_tokens=None, max_tool_calls=None, previous_response_id=None, prompt=None, prompt_cache_key=None, reasoning=Reasoning(effort='none', generate_summary=None, summary=None), safety_identifier=None, service_tier='default', status='completed', text=ResponseTextConfig(format=ResponseFormatTextJSONSchemaConfig(name=<redacted>, schema_=<redacted> type='json_schema', description=None, strict=True), verbosity='medium'), top_logprobs=0, truncation='disabled', usage=ResponseUsage(), user=None, store=True, billing={'payer': 'developer'}, completed_at=1776148879, frequency_penalty=0.0, presence_penalty=0.0, prompt_cache_retention=None)

TL;DR

To validate if web_search is functioning properly, verify that the "tools" parameter is correctly set in the response_endpoint_params and check the response payload for the presence of web search results.

Guidance

• Review the response_endpoint_params dictionary to ensure that the "tools" key is correctly populated with the web search configuration when web_search is True.
• Check the response payload for the presence of a WebSearchTool object in the tools list, which indicates that the web search tool was called.
• Verify that the search_context_size parameter is correctly set in the WebSearchTool object.
• Compare the expected output schema with the actual response payload to ensure that the web search results are being returned as expected.

Example

if web_search:
    print(response_endpoint_params["tools"])  # Verify that the tools key is populated
    print(response.output[0].tools)  # Verify that the WebSearchTool object is present in the response

Notes

The issue may be due to the web_search parameter not being correctly set or the response_endpoint_params not being properly updated. Additionally, the output schema may not be correctly configured to return the web search results.

Recommendation

Apply a workaround by manually verifying the response_endpoint_params and response payload to ensure that the web search tool is being called and returning the expected results.