litellm - 💡(How to fix) Fix [Feature]: OCI provider: Cannot set servingType to DEDICATED (UI missing option) [1 participants]

Check for existing issues

• I have searched the existing issues and checked that my issue is not a duplicate.

The Feature

When configuring the OCI provider in LiteLLM, the parameter servingType is automatically set to ON_DEMAND by default. However, there is no option in the UI to change this value to DEDICATED.

Motivation, pitch

I'm working on integrating OCI as a provider in LiteLLM, specifically targeting deployments that require DEDICATED serving type.

Currently, the servingType parameter is automatically set to ON_DEMAND, and there is no way to override this value through the UI. This creates a limitation when working with OCI setups that require DEDICATED, making it impossible to fully configure the provider from the UI.

This feature request is motivated by the need to support a broader range of OCI deployment configurations directly within LiteLLM, without requiring manual workarounds or code-level changes.

Providing an option to select servingType (e.g., ON_DEMAND vs DEDICATED) would improve flexibility and make OCI integration more complete and production-ready.

What part of LiteLLM is this about?

UI Dashboard

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

Yes

Twitter / LinkedIn details

https://www.linkedin.com/in/kareem-alkoul/