hermes - 💡(How to fix) Fix session_search becomes very slow on long sessions because it appears to read and summarize the entire session [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
NousResearch/hermes-agent#16671Fetched 2026-04-28 06:51:45
View on GitHub
Comments
0
Participants
1
Timeline
3
Reactions
0
Participants
Timeline (top)
labeled ×3

Root Cause

From the user side, this feels unexpected because "search session history" sounds like it should behave like a fast history search. But in practice, it seems that after finding matches, Hermes may read and summarize too much of the full session, which becomes expensive on long conversations.

RAW_BUFFERClick to expand / collapse

Hi, I want to report a usability/performance problem with session_search.

I am not a programmer, so I may not describe the internals perfectly, but the user-facing problem is very clear:

When a conversation session becomes long, session_search can take a very long time. In my case, I have some sessions with 800+ messages, and searching past conversations becomes slow enough that it feels stuck.

From the user side, this feels unexpected because "search session history" sounds like it should behave like a fast history search. But in practice, it seems that after finding matches, Hermes may read and summarize too much of the full session, which becomes expensive on long conversations.

Why this matters: Non-programmer users may keep very long sessions without knowing this will hurt recall/search speedThis is likely not just my issue; many normal users probably have long sessionsThe problem is hard to report clearly unless someone inspects the implementationUsers may think the model is broken, frozen, or unreliable, when the real issue is the search strategy on long sessions Suggested improvements: Add a fast/default mode for session_search that only uses matched snippets plus nearby context firstAvoid reading the entire session transcript by default for very long sessionsOnly do full-session summarization when the user explicitly asks for a deep recapAdd safeguards for very large sessions (message-count or token-based limits)Make the UX clearer about whether this is "fast search" or "deep summary" Expected behavior: session_search should stay responsive even for very long sessionsLong sessions should degrade gracefully instead of becoming extremely slow Actual behavior: On long sessions (for example, 800+ messages), session_search can take a very long time This seems especially important for non-technical users, because they are less likely to know they should manually split sessions or work around the issue.

Thanks.

extent analysis

TL;DR

Implement a fast search mode for session_search that only uses matched snippets and nearby context to improve performance on long sessions.

Guidance

  • Consider adding a message-count or token-based limit to prevent full-session summarization on very long sessions.
  • Introduce a default mode for session_search that prioritizes speed over comprehensive summarization.
  • Implement a user-initiated "deep recap" feature to allow users to explicitly request full-session summarization when needed.
  • Review the current search strategy to identify opportunities for optimization, such as lazy loading or caching of search results.

Example

No code example is provided due to the lack of technical implementation details in the issue.

Notes

The suggested improvements may require significant changes to the underlying implementation of session_search. It is essential to balance the need for performance with the need for accurate and comprehensive search results.

Recommendation

Apply a workaround by introducing a fast search mode with limits on session length or token count, as this approach addresses the reported performance issue without requiring a full overhaul of the search strategy.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

hermes - 💡(How to fix) Fix session_search becomes very slow on long sessions because it appears to read and summarize the entire session [1 participants]