claude-code - 💡(How to fix) Fix [BUG] API Error Prompt is too long [1 participants]

On the windows desktop app (probably also on mac). There is a error that the prompt is too long while the agent is running. But the context is only filled to 51% (101.5k tokens). This happens often on long running tasks. there is no option to auto compact, or just remove older context so this screws up the workflow.

Error Messages/Logs

API Error

TL;DR

The issue can likely be mitigated by implementing a feature to auto-compact or remove older context in the desktop app to prevent the "prompt is too long" error.

Guidance

• Investigate the Anthropic API documentation to see if there are any existing parameters or endpoints that can be used to limit the context size or implement auto-compaction.
• Consider adding a feature to the desktop app to manually remove older context or compact it when the context size reaches a certain threshold.
• Review the changes made in the new desktop app version to identify what might be causing this regression and if there's a way to revert or modify those changes.
• Test the app with a smaller context size to see if the error still occurs and to determine the exact threshold for the "prompt is too long" error.

Example

No code example can be provided without more information about the app's codebase.

Notes

The solution may require modifications to the desktop app or the way it interacts with the Anthropic API. Without more information about the app's code and the API's capabilities, it's difficult to provide a more specific solution.

Recommendation

Apply workaround: Implement a feature to auto-compact or remove older context in the desktop app, as this is likely to mitigate the issue and improve the overall workflow.