litellm - 💡(How to fix) Fix [Bug]: Request logs should show aggregate cost and duration [1 participants]

TL;DR

The issue can be addressed by modifying the Request Logs page to aggregate cost and duration for all requests in a session, rather than only showing the most recent request's values.

Guidance

• Verify that the session ID is correctly passed and requests are being grouped by session ID in the Request Logs page.
• Check the data source for the Cost and Duration columns to ensure it is retrieving the aggregated values for the entire session, rather than just the most recent request.
• Consider modifying the pagination logic to handle cases where a session has more than 50 requests, to prevent requests from being cut off.
• Review the session details page to understand how the correct aggregated values are being calculated and displayed.

Example

No code example is provided as the issue does not include specific code snippets or APIs.

Notes

The issue seems to be related to the UI Dashboard and data aggregation, but without more information about the underlying code or data structures, it's difficult to provide a more specific solution.

Recommendation

Apply a workaround to modify the Request Logs page to aggregate cost and duration for all requests in a session, as the correct values are already available in the session details page.