hermes - 💡(How to fix) Fix Tool calling failure when using Hermes in phone (termex) [1 participants]

What I observed is that every day or after few hours of conversation Hermes is facing issues in tool calling and it says token limit reached even when we have lot of limit left. This is not with one model but I see this with multiple models like Minimaxm2.6 cloud, qwen coder, deepseek, mistral, so every time when it starts facing that issue then for any message input it will do tool calling and error occurs. Some times it will say API call failed. The only solution is to entirely reconfigure Hermes with same API key and it works. Attached screen shot for reference , it's a fresh chat I started saying Hi and I see error.

TL;DR

Reconfiguring Hermes with the same API key temporarily resolves the token limit issue, suggesting a potential authentication or session management problem.

Guidance

• Investigate the token management and authentication mechanism used by Hermes to identify potential issues with token expiration, renewal, or validation.
• Verify the API key configuration and usage across different models (e.g., Minimaxm2.6 cloud, qwen coder, deepseek, mistral) to ensure consistency and proper key rotation.
• Check for any rate limiting or quota restrictions on the API side that might be triggering the "token limit reached" error, even if the reported limit appears to be sufficient.
• Consider implementing a retry mechanism or exponential backoff strategy for API calls to handle temporary errors and reduce the likelihood of token limit issues.

Notes

The root cause of the issue is unclear, and more information about the Hermes configuration, API usage, and error logs would be necessary to provide a definitive solution.

Recommendation

Apply workaround: Reconfigure Hermes with the same API key when the issue occurs, as this has been observed to temporarily resolve the problem. This allows for continued functionality while further investigation into the root cause is conducted.