Fix Plan

To fix the missing always_include_stream_usage setting, you can try the following steps:

• Edit the configuration file directly to add the missing setting.
• Update the UI to reflect the changes.

Here's an example of how you can add the setting to the configuration file:

# config.yml
router_settings:
  general:
    always_include_stream_usage: true

Alternatively, you can use the LiteLLM API to update the setting programmatically:

import requests

# Replace with your API endpoint and credentials
api_endpoint = "https://your-litellm-instance.com/api"
api_token = "your-api-token"

# Update the router settings
response = requests.patch(
    f"{api_endpoint}/router/settings",
    headers={"Authorization": f"Bearer {api_token}"},
    json={"always_include_stream_usage": True}
)

# Check if the update was successful
if response.status_code == 200:
    print("Setting updated successfully")
else:
    print("Failed to update setting")

Verification

To verify that the fix worked, navigate to the Settings > Router Settings > General page and check if the always_include_stream_usage setting is now visible and enabled.

Extra Tips

• Make sure to restart the LiteLLM service after updating the configuration file for the changes to take effect.
• If you're using a load balancer or proxy, ensure that it's configured to forward the always_include_stream_usage setting to the LiteLLM instance.