claude-code - 💡(How to fix) Fix [Feature Request] Implement background compaction with bridging to eliminate user-facing lag during context window compaction [1 participants]

TL;DR

Implementing a background compaction process with a secondary bridging step may help mitigate the lag issue.

Guidance

• Consider adjusting the compaction window to a lower value (e.g., 200K or 400K) to reduce the likelihood of reaching the 1M context window limit.
• Explore the possibility of running compaction in the background while allowing the current task to continue, and then perform a quick bridging step to append user inputs or activity since compaction started.
• Investigate the feasibility of implementing a buffering mechanism to handle user inputs or activity during the compaction process.
• Evaluate the performance impact of the proposed solution on the system, particularly with regards to memory usage and processing power.

Notes

The effectiveness of the proposed solution may depend on the specific system configuration, usage patterns, and performance characteristics. Further testing and evaluation are necessary to determine the optimal approach.

Recommendation

Apply workaround: Implementing a background compaction process with a secondary bridging step, as it may help mitigate the lag issue without requiring significant changes to the underlying system.