hermes - 💡(How to fix) Fix [Feature]: token context window is too high for small offline users as well as small LLM model APIs

Problem or Use Case

every time hit with same error "Failed to initialize agent: Model google/codegemma-7b has a context window of 32,768 tokens, which is below the minimum 64,000 required by Hermes Agent." with different LLM models and even in offline Models too, it is too high 64k. if possible than please reduce its size. so that anyone can use that without any hesitation. yes there are some way but it is tricky and mannual so its hard to non tech person.

Proposed Solution

you can give option to choose the token window size so that person can use it very easily.

Alternatives Considered

No response

Feature Type

Configuration option

Scope

Small (single file, < 50 lines)

Contribution

• I'd like to implement this myself and submit a PR

Debug Report (optional)