hermes - 💡(How to fix) Fix [Feature] Quality-gated fallback: autoCurrent fallback only triggers on HTTP errors (429, timeout). No way to auto-escalate when a cheap model (e.g. deepseek-v4-flash) produces poor responses.-escalate to stronger model when weaker one underperforms

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Code Example

MiniMax (free)flash (cheap)pro (expensive)

---

- provider: deepseek
  model: deepseek-v4-flash
  quality_gated:
    enabled: true
    max_consecutive_issues: 3
    signals:
      - self_reported_failure
      - tool_loop_detected
      - user_sentiment_negative
RAW_BUFFERClick to expand / collapse

Problem

Current fallback only triggers on HTTP errors (429, timeout). No way to auto-escalate when a cheap model (e.g. deepseek-v4-flash) produces poor responses.

Use Case

Typical cost-saving chain:

MiniMax (free) → flash (cheap) → pro (expensive)

User must manually re-ask with pro when flash fails. Breaks autonomy.

Proposed Solution

Add quality_gated config in fallback_providers:

- provider: deepseek
  model: deepseek-v4-flash
  quality_gated:
    enabled: true
    max_consecutive_issues: 3
    signals:
      - self_reported_failure
      - tool_loop_detected
      - user_sentiment_negative

Simpler Alternative

A /pro slash command to switch to deepseek-v4-pro mid-session.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

hermes - 💡(How to fix) Fix [Feature] Quality-gated fallback: autoCurrent fallback only triggers on HTTP errors (429, timeout). No way to auto-escalate when a cheap model (e.g. deepseek-v4-flash) produces poor responses.-escalate to stronger model when weaker one underperforms