litellm - 💡(How to fix) Fix WebRTC (gpt-realtime) cost tracking not working in LiteLLM v1.82.3 [1 participants]

The backend logs show the following error:

TL;DR

The issue might be due to missing support for WebRTC-based models in LiteLLM's cost tracking feature, requiring a potential update or workaround.

Guidance

• Verify the documentation for LiteLLM (v1.82.3) to confirm if WebRTC-based models like Azure OpenAI gpt-realtime are supported for cost tracking.
• Check the LiteLLM configuration to ensure that cost tracking is enabled for the gpt-realtime model.
• Investigate the backend logs for any additional error messages that might provide more insight into the "Cost tracking failed" error.
• Consider reaching out to the LiteLLM community or support team to inquire about potential workarounds or upcoming support for WebRTC-based models.

Notes

The current version of LiteLLM (v1.82.3) may not support cost tracking for WebRTC-based models, which could be the root cause of the issue.

Recommendation

Apply workaround: Given the lack of clear support for WebRTC-based models in the current version, applying a workaround or seeking assistance from the LiteLLM community might be the best course of action until official support is added.