litellm - 💡(How to fix) Fix [Bug]: Error reported when configuring the OpenAI API for the Aliyun Coding Plan in the Litellm backend [3 comments, 2 participants]

cluade code error:

TL;DR

The error "Cannot read properties of undefined (reading 'input_tokens')" suggests a potential issue with the configuration or the model's input handling, which may be resolved by verifying the model settings and input data.

Guidance

• Review the litellm_params and model_info configurations to ensure that the input_tokens property is correctly defined and passed to the model.
• Check the api_base and api_key settings to verify that the API connection is established correctly and the model is properly initialized.
• Investigate the drop_params setting in litellm_settings, as it may be causing the input_tokens property to be dropped or undefined.
• Verify that the input data being passed to the model is correctly formatted and contains the required input_tokens property.

Example

No specific code example can be provided without more context, but ensuring that the input_tokens property is defined and passed correctly to the model is crucial.

Notes

The issue may be related to the specific model version (qwen3.5-plus) or the API connection settings. Further investigation into the model's documentation and the API's requirements may be necessary to resolve the issue.

Recommendation

Apply workaround: Verify and adjust the model settings and input data to ensure that the input_tokens property is correctly defined and passed to the model. This is recommended because the issue seems to be related to the configuration or input handling, and adjusting these settings may resolve the error without requiring an upgrade or more invasive changes.