hermes - 💡(How to fix) Fix ModuleNotFoundError: agent.smart_model_routing missing from latest release [2 comments, 2 participants]

Bug Description

When running Hermes Agent selfhost container (nousresearch/hermes-agent:latest), users receive the following error when sending messages:

ModuleNotFoundError: No module named 'agent.smart_model_routing'

Full Traceback

File "/opt/hermes/gateway/run.py", line 954, in _resolve_turn_agent_config
    from agent.smart_model_routing import resolve_turn_route
ModuleNotFoundError: No module named 'agent.smart_model_routing'

Evidence

1. Official repo does not contain the file: https://github.com/NousResearch/hermes-agent/blob/main/agent/smart_model_routing.py returns 404

2. Docker image missing the module: Running ls /opt/hermes/agent/ in the container shows 41 Python files, but smart_model_routing.py is NOT among them

3. Hard dependency without fallback: The import in gateway/run.py line 954 is a direct import without try-except wrapper, causing immediate crash

Code Reference

From /opt/hermes/gateway/run.py:

def _resolve_turn_agent_config(self, user_message: str, model: str, runtime_kwargs: dict) -> dict:
    from agent.smart_model_routing import resolve_turn_route  # <-- This module doesn't exist
    from hermes_cli.models import resolve_fast_mode_overrides
    
    primary = {
        "model": model,
        ...
    }
    route = resolve_turn_route(user_message, getattr(self, "_smart_model_routing", {}), primary)

Impact

• Severity: Critical - blocks all message processing
• Trigger: Any user message sent through gateway (Feishu, Discord, etc.)
• Affected users: All selfhost users using latest image pulled in the last 24 hours

Environment

• Image: nousresearch/hermes-agent:latest (sha: bca0dbade0cb, built ~3 hours ago)
• Platform: Docker on Synology NAS
• Gateway: Feishu channel

Suggested Fix

Either:

1. Add the missing agent/smart_model_routing.py module to the repository and rebuild the image
2. Or wrap the import in a try-except block with a fallback behavior when the module is unavailable

Related Code

The _load_smart_model_routing() method at line 1334 loads config from config.yaml, suggesting this feature was intended but the implementation file was never committed.

This appears to be a release packaging issue where a new feature was partially integrated but the core module was left out of the final image. Would appreciate a quick fix as this blocks all selfhost deployments.