litellm - 💡(How to fix) Fix [Feature]: use_redis_transaction_buffer should be usable when not using Redis cache

Check for existing issues

• I have searched the existing issues and checked that my issue is not a duplicate.

The Feature

Support a general Redis configuration that can be used by use_redis_transaction_buffer function, separate from Redis cache configuration.

Enable the use case of using use_redis_transaction_buffer with other types of cache (disk, s3, etc).

Motivation, pitch

In litellm:1.85.1 proxy server, server start would fail when use_redis_transaction_buffer is turned on but the proxy is configured with a different kind of cache.

Since use_redis_transaction_buffer is a required configuration for high-volume deployment, it should be able to work without being coupled with Redis cache usage.

What part of LiteLLM is this about?

Proxy

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

@weiwei9