litellm - 💡(How to fix) Fix [Bug]: Pricing Data Source Anthropic Bedrock prices wrong [1 comments, 2 participants]

TL;DR

Update the price data in the model_prices_and_context_window.json file to reflect the correct prices for Anthropic models from AWS.

Guidance

• Verify the prices listed in the AWS documentation for Anthropic models to confirm the discrepancy.
• Check the model_prices_and_context_window.json file for any other incorrect prices that may need to be updated.
• Consider implementing a process to regularly update the price data to ensure accuracy and prevent similar issues in the future.
• Review the LiteLLM code to see if there are any price calculation or retrieval functions that may be contributing to the discrepancy.

Example

No code example is provided as the issue is related to data accuracy rather than code functionality.

Notes

The issue may be specific to the LiteLLM version 1.83.10, and updating to a newer version may not necessarily resolve the issue. Additionally, the prices listed in the model_prices_and_context_window.json file may be subject to change over time, so regular updates may be necessary.

Recommendation

Apply workaround: Update the price data in the model_prices_and_context_window.json file to reflect the correct prices for Anthropic models from AWS, as this is a data accuracy issue rather than a code functionality issue.