ollama - 💡(How to fix) Fix Problem with submitting multiple images to qwen3.5:27b as opposed to qwen3.5:397b-cloud [2 comments, 2 participants]

I am facing a problem with qwen3.5:27b when submitting a list of 2-3 images (representing the pages of a same document) along with a single text prompt requiring content extraction of the images. With qwen3.5:397b-cloud, everything runs fine as expected. But with qwen3.5:27b, using exactly the same prompt and same images, I consistently get the following error message: "Internal Server Error -- Failed to create new sequence: SameBatch may not be specified within numKeep (index: 3 numKeep: 4 SameBatch: 2017)". This is true whether using the "generate" or "chat" API endpoints. I located the source of this error message in https://github.com/ollama/ollama/blob/main/runner/ollamarunner/runner.go but I do not see how to circumvent this behavior.

Fix Plan

The issue seems to be related to the SameBatch parameter in the numKeep configuration. To fix this, you can try modifying the numKeep value or adjusting the SameBatch parameter.

Here are the steps to follow:

• Check the numKeep configuration in your Ollama setup and reduce the value to 3 or less.
• Alternatively, you can try setting SameBatch to a value less than numKeep.

Example code snippet to adjust numKeep:

// In runner.go, update the numKeep value
numKeep := 3

Or, you can modify the SameBatch value:

// In runner.go, update the SameBatch value
SameBatch := 2016

Note: You may need to recompile the Ollama code after making these changes.

Verification

To verify that the fix worked, try submitting the same list of images and text prompt again. If the error persists, you may need to adjust the numKeep or SameBatch values further.

Extra Tips

• Make sure to check the Ollama documentation for any specific guidelines on configuring numKeep and SameBatch.
• If you're still experiencing issues, try updating to a newer version of Ollama or seeking support from the Ollama community.