litellm - 💡(How to fix) Fix [Bug]: vertex_ai/claude-opus-4-7 fails with 404 on multi-region endpoint — eu/us locations not supported [1 participants]

Check for existing issues

• I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

claude-opus-4-7 on Vertex AI is only available in multi-region (eu, us) and global endpoints — it is not available in individual regions like europe-west1. See Google's official docs (https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/opus-4-7).

The multi-region endpoint requires a different API domain:

• EU: https://aiplatform.eu.rep.googleapis.com
• US: https://aiplatform.us.rep.googleapis.com

LiteLLM does not support these domains. When setting vertex_ai_location: 'eu', LiteLLM constructs https://eu-aiplatform.googleapis.com/... which is an invalid URL and returns 404. The only workaround is vertex_ai_location: 'global', which bypasses data residency requirements and is not be acceptable for EU deployments.

Steps to Reproduce

1. Set up a LiteLLM proxy config with claude-opus-4-7 on Vertex AI using the EU multi-region location: model_list:

• model_name: claude-4-7-opus litellm_params: model: vertex_ai/claude-opus-4-7 vertex_ai_location: 'eu' vertex_ai_project: your-gcp-project vertex_credentials: /path/to/credentials.json

1. Send a chat completion request to the proxy
2. Observe the 404 error

Relevant log output

MaskedHTTPStatusError: Client error '404 Not Found' for url
'https://eu-aiplatform.googleapis.com/v1/projects/<project>/locations/eu/publishers/anthropic/models/claude-opus-4-7:streamRawPredict'
litellm.exceptions.NotFoundError: litellm.NotFoundError: Vertex_aiException - 404 Not Found

The correct EU multi-region URL should be:
https://aiplatform.eu.rep.googleapis.com/v1/projects/<project>/locations/eu/publishers/anthropic/models/claude-opus-4-7:streamRawPredict

What part of LiteLLM is this about?

Proxy

What LiteLLM version are you on ?

v1.83.10

Twitter / LinkedIn details

No response