hermes - 💡(How to fix) Fix Self-Verification Loop: Generate → Verify → Refine [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
NousResearch/hermes-agent#13532Fetched 2026-04-22 08:06:00
View on GitHub
Comments
0
Participants
1
Timeline
2
Reactions
0
Participants
Timeline (top)
labeled ×2
RAW_BUFFERClick to expand / collapse

Описание

Добавить в SOUL.md и процесс self-check цикл верификации сложных ответов.

Правила цикла

  1. Generate draft — сгенерировать черновик ответа
  2. Self-verify:
    • Факты: recall проверен? Логи/файлы сверены если система?
    • Код: синтаксис? Пути? Нет placeholder/TODO?
    • Полнота: покрыты ВСЕ аспекты вопроса?
    • Безопасность: нет ключей/паролей? Нет деструктивных действий без approve?
  3. If issues → Refine — улучшить и повторить verify
  4. Only then → Send

Пример

Q: «Сколько RAM занято на сервере 91.188.215.135?»

  • Без цикла: "примерно 1.5GB" (неточно)
  • С циклом: сначала SSH free -h → точные цифры

Реализация

  • SOUL.md секция 3: Self-Verification Loop (COMPLETED)
  • skills/self-check.yaml: steps с Generate/Verify/Refine/Send (COMPLETED)

Примечание

Основано на Self-Verification Prompting (Dimitry Volos) — https://www.dimitryvolos.com/blog/self-verification-prompting

extent analysis

TL;DR

Implement a self-verification loop in the response generation process to ensure accuracy and completeness of answers.

Guidance

  • Review the self-verification loop rules to understand the required steps: Generate draft, Self-verify, Refine (if issues), and Send.
  • Ensure that the self-verification loop checks for facts, code syntax, completeness, and security to prevent errors and inaccuracies.
  • Use the provided example as a reference to implement the self-verification loop in the SOUL.md and skills/self-check.yaml files.
  • Verify that the implementation covers all aspects of the question and provides accurate information.

Example

No code snippet is provided as the issue does not contain specific code-related information.

Notes

The implementation of the self-verification loop is based on the Self-Verification Prompting concept by Dimitry Volos, and its effectiveness may depend on the specific use case and requirements.

Recommendation

Apply the self-verification loop workaround to improve the accuracy and completeness of generated responses, as it provides a structured approach to verifying and refining answers.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING