hermes - 💡(How to fix) Fix [Feature]: delegation-per-task-endpoint-overrides [1 comments, 2 participants]

TL;DR

Extend the delegate_task schema to include optional base_url, provider, and api_key fields to enable per-task model routing overrides.

Guidance

• Review the proposed solution to ensure it aligns with the existing internal override support in _build_child_agent().
• Verify that the extended task schema is properly wired into the _build_child_agent() function to apply task-level overrides.
• Test the implementation to ensure true parallel execution across multiple inference servers.
• Consider adding validation for the optional fields to prevent potential errors.

Example

{
  "base_url": "http://host:11434/v1",
  "provider": "custom",
  "api_key": "ollama"
}

This example shows the proposed optional fields for the task schema.

Notes

The implementation should be fully backward compatible, but thorough testing is necessary to ensure that the changes do not introduce any regressions.

Recommendation

Apply the proposed workaround by extending the delegate_task schema and wiring the task-level overrides into _build_child_agent(), as this enables true parallel execution across multiple inference servers.