litellm - 💡(How to fix) Fix [Feature]: support passing api keys through sdk instead of environment for langfuse otel integrarion [1 participants]

TL;DR

Modify the langfuse otel integration to allow explicit passing of keys and host parameters when initializing the client or calling a completion, using environment variables as a fallback.

Guidance

• Review the current implementation of the langfuse otel integration in the LiteLLM Python package to identify where environment variables are being used to derive keys and host.
• Update the client initialization and completion calling functions to accept explicit keys and host parameters.
• Implement a fallback mechanism to use environment variables when explicit parameters are not provided.
• Consider adding input validation to ensure that either explicit parameters or environment variables are set to avoid errors.

Example

# Example of updated client initialization with explicit parameters
def initialize_client(keys=None, host=None):
    if keys is None:
        keys = os.environ.get('KEYS')
    if host is None:
        host = os.environ.get('HOST')
    # ... rest of the initialization code ...

Notes

The exact implementation details may vary depending on the current code structure and requirements of the langfuse otel integration.

Recommendation

Apply workaround: Update the langfuse otel integration to support explicit parameter passing, as this provides better security practices by not relying solely on environment variables.