claude-code - 💡(How to fix) Fix [Bug] Excessive token consumption from system prompt and slow response times in Claude Code [1 participants]

TL;DR

The most likely fix is to exclude system prompts from token counting and optimize the loading of system prompts to prevent redundant loading with every interaction.

Guidance

• Investigate the token counting mechanism to determine why system prompts are being included in the token count, and consider modifying it to exclude these prompts.
• Review the system prompt loading process to identify opportunities for optimization, such as loading the prompt only once per session instead of with every interaction.
• Consider implementing a more efficient session tracking mechanism to reduce compute resource waste and improve overall performance.
• Evaluate the current system architecture to identify potential bottlenecks or areas for improvement that may be contributing to the slow response times and high token usage.

Example

No code snippet is provided as the issue does not contain sufficient technical details to create a specific example.

Notes

The issue lacks detailed technical information, making it challenging to provide a comprehensive solution. The suggestions provided are based on the user's description of the problem and may require further investigation to implement effectively.

Recommendation

Apply workaround: Exclude system prompts from token counting and optimize the loading of system prompts. This is a temporary solution to alleviate the immediate issue, but a more permanent fix may require a deeper investigation into the system architecture and token counting mechanism.