litellm - 💡(How to fix) Fix [Feature]: Use IRSA for S3 connections [1 participants]

TL;DR

Update the logging documentation for S3 to use IAM Roles for Service Accounts (IRSA) instead of AWS access keys for authentication.

Guidance

• Investigate how to configure IRSA for the Proxy component in LiteLLM to enable least privilege access and credential isolation.
• Review the AWS documentation on IRSA to understand the requirements for setup and integration with S3 logging.
• Consider the security benefits of using IRSA, such as improved audibility and reduced risk of credential exposure.
• Evaluate the potential changes needed to the logging documentation and Proxy configuration to support IRSA authentication.

Notes

The implementation details of IRSA with S3 logging are not provided, so further research and testing may be necessary to ensure a smooth integration.

Recommendation

Apply workaround: Update the logging documentation to use IRSA, as it provides better security and easier configuration compared to using AWS access keys.