litellm - 💡(How to fix) Fix [Feature]: Handle 10 Image Link Limit on Vertex AI [1 comments, 2 participants]

Check for existing issues

• I have searched the existing issues and checked that my issue is not a duplicate.

The Feature

LiteLLM Proxy Version: v1.81.9

Gemini Pro 3.1 Preview model (and likely others) on Vertex AI have a limit of 10 image links. We regularly hit this limit and get this error:

'litellm.BadRequestError: Vertex_aiException BadRequestError - {
  "error": {
    "code": 400,
    "message": "You can only include 10 image links. Please reduce the number accordingly.",
    "status": "INVALID_ARGUMENT"
  }
}

This limit only applies to image links, there can be more base64 embedded images in the conversation. I know that LiteLLM is already fully capable of converting image links into embedded base64 encoded images (for models which do not support image links at all). Hence, I would really love to see it handling this limit internally and converting image links into base64 embedded images once this limit has been reached.

Motivation, pitch

See above

What part of LiteLLM is this about?

Proxy

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

No response