litellm.BadRequestError: VertexAIException - 400 {
"error": {
"message": "Multiple tools are supported only when they are all search tools",
"status": "INVALID_ARGUMENT" } }

TL;DR

Modify the LiteLLM proxy to handle the conflict between function calling tools and web_search_options by ensuring _resolve_search_tool_conflict checks for both types of tools.

Guidance

• Review the _map_function and _map_web_search_options functions to understand how tools are mapped independently, leading to the conflict.
• Consider modifying the _resolve_search_tool_conflict function to run outside of _map_function to catch conflicts between function declarations and web_search_options.
• Verify that the Vertex AI mapper is correctly handling the updated tool mappings.
• Test the modified proxy with a chat completion request that includes both function calling tools and web_search_options to ensure the 400 error is resolved.

Example

No code snippet is provided as the issue does not include sufficient code context.

Notes

The solution may require changes to the LiteLLM proxy code, specifically in the _resolve_search_tool_conflict function. The exact implementation will depend on the internal workings of the LiteLLM proxy.

Recommendation

Apply a workaround by modifying the LiteLLM proxy to handle the tool conflict, as the issue is specific to the proxy's interaction with Vertex AI and there is no clear indication of a fixed version that resolves this issue.