hermes - 💡(How to fix) Fix fix(metadata): hy3-preview context length test fails (256000 vs 262144)

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Root Cause

OpenRouter's live API now reports hy3-preview with context_length: 262144 (up from the original 256000 when the model first launched on 2026-04-20).

get_model_context_length("hy3-preview") hits the OpenRouter metadata cache at step 6 in the resolution chain (before reaching the stale static fallback at step 8), so it returns 262144. The test assertion and the DEFAULT_CONTEXT_LENGTHS static table both have the old value.

Fix Action

Fix

Update both:

  • agent/model_metadata.py: "hy3-preview": 262144
  • tests/hermes_cli/test_tencent_tokenhub_provider.py: assert ctx == 262144

Code Example

FAILED tests/hermes_cli/test_tencent_tokenhub_provider.py::TestTencentTokenhubContextLength::test_hy3_preview_context_length
  assert 262144 == 256000
RAW_BUFFERClick to expand / collapse

Bug

TestTencentTokenhubContextLength::test_hy3_preview_context_length fails on main:

FAILED tests/hermes_cli/test_tencent_tokenhub_provider.py::TestTencentTokenhubContextLength::test_hy3_preview_context_length
  assert 262144 == 256000

Root Cause

OpenRouter's live API now reports hy3-preview with context_length: 262144 (up from the original 256000 when the model first launched on 2026-04-20).

get_model_context_length("hy3-preview") hits the OpenRouter metadata cache at step 6 in the resolution chain (before reaching the stale static fallback at step 8), so it returns 262144. The test assertion and the DEFAULT_CONTEXT_LENGTHS static table both have the old value.

Fix

Update both:

  • agent/model_metadata.py: "hy3-preview": 262144
  • tests/hermes_cli/test_tencent_tokenhub_provider.py: assert ctx == 262144

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

hermes - 💡(How to fix) Fix fix(metadata): hy3-preview context length test fails (256000 vs 262144)