Issue Station
Sign In
Tools hereToolbox

hermes - ✅(Solved) Fix goal_judge auxiliary model missing from dashboard UI and hardcoded model suggestion in error message [1 pull requests, 1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
NousResearch/hermes-agent#22936•Fetched 2026-05-11 03:32:17
View on GitHub
Comments
0
Participants
1
Timeline
6
Reactions
0
Author
CalmProtonCalmProton
Participants
CalmProtonCalmProton
Timeline (top)
labeled ×5cross-referenced ×1

The goal_judge auxiliary model is not listed in either the web dashboard Models page (http://127.0.0.1:9119/models) or the CLI hermes model wizard. Users cannot configure the goal judge model through the UI — they must manually edit ~/.hermes/config.yaml.

Additionally, the goal auto-pause error message in goals.py hardcodes google/gemini-3-flash-preview as a recommendation, which is misleading because:

  1. It makes it look like the model IS already set to that value
  2. It doesn't tell the user what model is actually being used

Error Message

Additionally, the goal auto-pause error message in goals.py hardcodes google/gemini-3-flash-preview as a recommendation, which is misleading because:

Root Cause

Additionally, the goal auto-pause error message in goals.py hardcodes google/gemini-3-flash-preview as a recommendation, which is misleading because:

  1. It makes it look like the model IS already set to that value
  2. It doesn't tell the user what model is actually being used

Fix Action

Fix

See PR for implementation.

PR fix notes

PR #22938: fix(cli): add goal_judge to auxiliary model dashboards and remove hardcoded model suggestion

Description (problem / solution / changelog)

Summary

  • Adds goal_judge to both the web dashboard Models page and the CLI hermes model wizard so users can configure the goal judge model through the UI
  • Adds goal_judge default entry to DEFAULT_CONFIG with "auto" (inherits main model)
  • Replaces the hardcoded google/gemini-3-flash-preview suggestion in the auto-pause error message with a generic reference to the dashboard and config file

Fixes

Closes #22936

Changes

FileChange
hermes_cli/web_server.pyAdded "goal_judge" to _AUX_TASK_SLOTS
hermes_cli/main.pyAdded "goal_judge" to _AUX_TASKS
hermes_cli/config.pyAdded "goal_judge" entry to DEFAULT_CONFIG["auxiliary"]
hermes_cli/goals.pyReplaced hardcoded model suggestion with generic dashboard+config reference

Testing

  • All 35 goal-related tests pass
  • No new test failures introduced
  • Existing test assertions on the error message ("auxiliary", "goal_judge", "config.yaml" in message) remain satisfied

Changed files

  • hermes_cli/config.py (modified, +8/-0)
  • hermes_cli/goals.py (modified, +6/-10)
  • hermes_cli/main.py (modified, +1/-0)
  • hermes_cli/web_server.py (modified, +1/-0)
RAW_BUFFERClick to expand / collapse

Description

The goal_judge auxiliary model is not listed in either the web dashboard Models page (http://127.0.0.1:9119/models) or the CLI hermes model wizard. Users cannot configure the goal judge model through the UI — they must manually edit ~/.hermes/config.yaml.

Additionally, the goal auto-pause error message in goals.py hardcodes google/gemini-3-flash-preview as a recommendation, which is misleading because:

  1. It makes it look like the model IS already set to that value
  2. It doesn't tell the user what model is actually being used

Steps to Reproduce

  1. Open http://127.0.0.1:9119/models — observe no "Goal judge" entry under auxiliary tasks
  2. Run hermes model → Auxiliary — observe no "Goal judge" option
  3. Set a goal with /goal <text> and have the judge fail 3+ times — observe hardcoded google/gemini-3-flash-preview in the pause message

Expected Behavior

  • "Goal judge" should appear in both the dashboard Models page and the CLI model wizard as a configurable auxiliary task
  • The auto-pause message should reference the dashboard/config file generically instead of hardcoding a specific model recommendation

Fix

See PR for implementation.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#model loading#dependency error#configuration error#environment variable#network issue

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING