hermes - 💡(How to fix) Fix [Feature]: Support Anthropic compatible endpoint for Hermes model Custom endpoint (not only OpenAI) [1 comments, 2 participants]

TL;DR

Modify the Hermes model Custom endpoint to add support for Anthropic compatible endpoints.

Guidance

• Identify the specific file and lines of code responsible for the OpenAI endpoint support in the Hermes model Custom endpoint.
• Investigate the differences between OpenAI and Anthropic APIs to determine the necessary changes for compatibility.
• Consider adding a configuration option to allow users to choose between OpenAI and Anthropic endpoints.
• Test the modified endpoint with Anthropic-based services to ensure functionality and flexibility.

Example

No explicit code example can be provided without more information about the existing implementation.

Notes

The scope of the change is reported as small, affecting a single file with less than 50 lines, which should simplify the modification process.

Recommendation

Apply a workaround by modifying the existing code to support Anthropic compatible endpoints, as this will provide the desired flexibility for users without waiting for a potential future update.