PR #11993: feat(agent): make smart_model_routing complex keywords configurable

• Repository: NousResearch/hermes-agent
• Author: alexzhu0
• State: open | merged: False
• Link: https://github.com/NousResearch/hermes-agent/pull/11993

Description (problem / solution / changelog)

What & why

smart_model_routing routes short/simple turns to a cheap model, but skips that route when the message contains any word from a hardcoded English set (debug, error, refactor, docker, …). The English-only list fails open for non-English users: e.g. a Polish request saying "napraw ten błąd" (fix this error) never trips the guard, so complex debugging work silently routes to the cheap model even when the user expects primary-model quality.

Per #11814, let self-hosters tune the list via config.yaml without patching source.

Change

Two optional keys under smart_model_routing:

smart_model_routing:
  enabled: true
  cheap_model: {provider: openrouter, model: google/gemini-2.5-flash}
  # Extend the built-in list (keeps English defaults + adds entries):
  complex_keywords_extra:
    - błąd
    - napraw
  # OR replace the built-in list entirely:
  # complex_keywords:
  #   - debug
  #   - error

Semantics (matches issue author's recommended Option 3):

• complex_keywords → full override — replaces the built-in set.
• complex_keywords_extra → extend — union with the built-in set.
• When both are set, full override wins (predictability for self-hosters who write an explicit list).
• Malformed values (non-list, non-string entries) degrade silently to built-ins.
• Entries are lowercased + stripped.
• Default behavior unchanged — both keys absent means the built-in list is used as before.

How to test

pytest tests/agent/test_smart_model_routing.py -v

→ 11 passed. 5 new test cases cover:

• test_complex_keywords_extra_extends_builtin — Polish trigger word routes correctly once added.
• test_complex_keywords_full_override_replaces_builtin — built-in debug stops triggering when overridden.
• test_complex_keywords_override_beats_extra — precedence rule when both keys are set.
• test_complex_keywords_normalize_case_and_whitespace — `" BŁĄD "` normalizes to błąd.
• test_complex_keywords_ignore_invalid_types — malformed values fall back to built-ins rather than crashing.

Commented example in hermes_cli/config.py updated to document both keys (two sections kept in sync).

Platforms tested

• macOS (Darwin 25.3.0), Python 3.11.13. Change is platform-agnostic.

Related

Closes #11814

Changed files

• agent/smart_model_routing.py (modified, +45/-1)
• hermes_cli/config.py (modified, +26/-0)
• tests/agent/test_smart_model_routing.py (modified, +57/-0)

PR #12003: feat: make smart_model_routing complex keywords configurable via config

• Repository: NousResearch/hermes-agent
• Author: kagura-agent
• State: closed | merged: False
• Link: https://github.com/NousResearch/hermes-agent/pull/12003

Description (problem / solution / changelog)

Closes #11814

Summary

Makes the hardcoded _COMPLEX_KEYWORDS list in smart_model_routing.py configurable through config.yaml.

Changes

• agent/smart_model_routing.py: Renamed _COMPLEX_KEYWORDS → _DEFAULT_COMPLEX_KEYWORDS, added _resolve_complex_keywords(cfg) that reads config
• cli.py: Added complex_keywords_extra and complex_keywords_override to config schema
• tests/agent/test_smart_model_routing.py: 4 new tests covering extra, override, combined, and default behavior

Config keys (under smart_model_routing)

• complex_keywords_extra: list of additional keywords merged with defaults
• complex_keywords_override: optional full replacement list (replaces defaults entirely)

All 10 routing tests pass.

Changed files

• agent/smart_model_routing.py (modified, +22/-2)
• cli.py (modified, +2/-0)
• tests/agent/test_smart_model_routing.py (modified, +37/-1)