hermes - 💡(How to fix) Fix [Feature]: Display input tokens used the same way as the context bar. [1 participants]

TL;DR

Displaying input tokens used, similar to the context bar, can help track expenditure and prevent unnecessary API costs.

Guidance

• To implement this feature, consider adding a token counter that updates in real-time as input is processed.
• This counter could be displayed as a bar or percentage, similar to the context bar, to provide a visual representation of token usage.
• The token limit (e.g., 1M tokens) should be clearly defined and considered when designing the display.
• When the token limit is approached or exceeded, a warning or notification could be triggered to alert the user.

Notes

The exact implementation details are not provided, so the guidance is focused on the general approach to displaying token usage.

Recommendation

Apply workaround: Implementing a token counter and display can help mitigate the issue of unknown token expenditure, allowing users to make more informed decisions about their API usage.