openclaw - 💡(How to fix) Fix Ollama Cloud models should receive native think: max instead of mapped think: high [1 comments, 2 participants]

TL;DR

Update the mapping logic to pass think: "max" natively for Ollama Cloud models while keeping the current mapping for local Ollama models.

Guidance

• Identify Ollama Cloud models by checking for the :cloud suffix in the model name or by probing the endpoint behavior.
• Update the code to conditionally map think: "max" to either "high" for local models or pass it natively for Cloud models.
• Consider implementing a fallback mechanism to handle cases where the endpoint rejects think: "max", such as probing think: "max" on first use and falling back to high if rejected.
• Verify the updated behavior by testing against both local and Cloud Ollama models using the provided curl command as a reference.

Example

# Example of conditional mapping logic (pseudo-code)
if model_name.endswith(":cloud"):
    think_value = "max"
else:
    think_value = "high"

Notes

The suggested solution relies on accurately detecting Ollama Cloud models, which can be done through the :cloud suffix or endpoint behavior. The fallback mechanism can help handle potential errors or inconsistencies in the Cloud API.

Recommendation

Apply the workaround by updating the mapping logic to conditionally handle think: "max" for Ollama Cloud models, as this allows users to access the full max reasoning effort supported by the underlying model.