litellm - 💡(How to fix) Fix [Feature]: Cache anthropic_messages [1 participants]

TL;DR

To support anthropic_messages, the supported_call_types list in the caching configuration needs to be updated to include this endpoint.

Guidance

• Review the caching.py file and locate the supported_call_types list to understand the current caching configuration.
• Add "anthropic_messages" to the supported_call_types list to enable caching for this endpoint.
• Verify that the caching functionality works as expected for anthropic_messages after updating the configuration.
• Check the LiteLLM documentation or codebase for any specific requirements or constraints related to caching anthropic_messages.

Example

supported_call_types: Optional[List[CachingSupportedCallTypes]] = [
    # ... existing endpoints ...
    "anthropic_messages",
]

Notes

The provided information does not specify any specific requirements or constraints for caching anthropic_messages. It is assumed that adding this endpoint to the supported_call_types list will enable caching.

Recommendation

Apply workaround: Update the supported_call_types list to include "anthropic_messages", as this is the most straightforward way to enable caching for this endpoint.