litellm - 💡(How to fix) Fix [Bug]: Bedrock API error when use model claude 4.6, drop_param not help [1 participants]

TL;DR

The issue can likely be resolved by ensuring that the tool_choice.type field is explicitly set when calling the Bedrock API, possibly through modifications in the LiteLLM configuration or the OpenKB chat interface.

Guidance

• Verify the LiteLLM configuration to see if there's an option to explicitly set the tool_choice.type field, potentially as part of the model invocation parameters.
• Check the OpenKB chat interface documentation to determine if there are any settings or configurations that could influence how tool_choice is passed to the Bedrock API.
• Consider modifying the LiteLLM configuration to include a default tool_choice.type value when no specific tools are required, to comply with the Bedrock API's requirements.
• Review the Bedrock API documentation to understand the expected format and values for the tool_choice object, including the type field.

Example

No specific code example can be provided without more details on the LiteLLM and OpenKB configurations, but the solution likely involves adding or modifying a configuration option similar to tool_choice: { type: 'default' } in the LiteLLM setup.

Notes

The exact solution depends on the specifics of the LiteLLM and OpenKB configurations, as well as the Bedrock API requirements. It's also possible that an update to LiteLLM or OpenKB could address this issue if it's a known problem.

Recommendation

Apply a workaround by explicitly setting the tool_choice.type field in the LiteLLM configuration or OpenKB chat interface settings, as this directly addresses the error message and the known requirement of the Bedrock API.