Issue Station
Sign In
Tools hereToolbox

litellm - 💡(How to fix) Fix [Feature]: Add zai provider [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
BerriAI/litellm#23327•Fetched 2026-04-08 00:37:31
View on GitHub
Comments
0
Participants
1
Timeline
3
Reactions
2
Author
lin0703lin0703
Participants
lin0703lin0703
Timeline (top)
labeled ×2cross-referenced ×1
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

The Feature

The official documentation mentions support for Zai (see https://docs.litellm.ai/docs/providers/zai). However, Zai is not available in the Provider when adding models or credentials in the UI, making it impossible to add GLM models within the UI. Adding models via YAML or curl is the only option, which is very inconvenient. The desired feature is to add Zai to the UI's Provider. This is from a well-known LLM company.

Motivation, pitch

I plan to use Zai's GLM5 model, but it can only be implemented using curl or YAML, not through the UI.

What part of LiteLLM is this about?

UI Dashboard

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

No response

extent analysis

Fix Plan

To add Zai as a provider in the UI, we need to update the backend to include Zai in the list of available providers.

Steps:

  • Update the providers list in the backend configuration to include Zai.
  • Add Zai-specific implementation for model and credential management.
  • Update the UI to display Zai as an available provider.

Example Code:

# providers.py
providers = [
    # ... existing providers ...
    {
        'name': 'Zai',
        'description': 'Zai AI provider',
        'credentials': ['api_key'],
        'models': ['GLM5']
    }
]

# ui.py
def get_providers():
    return providers

# Add Zai-specific implementation for model and credential management
def create_zai_model(model_name, credentials):
    # Implement Zai model creation using the provided credentials
    pass

def create_zai_credentials(api_key):
    # Implement Zai credential creation using the provided API key
    pass

Verification

To verify that the fix worked, check the UI for the presence of Zai as a provider when adding models or credentials. Attempt to add a GLM model using the UI to ensure that the implementation is correct.

Extra Tips

  • Ensure that the Zai API is properly integrated and tested to avoid any issues with model or credential management.
  • Consider adding error handling and logging to the Zai implementation to improve debugging and troubleshooting.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#ssr#installation#tensor shape#autograd error#API versioning#request timeout

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

litellm - 💡(How to fix) Fix [Feature]: Add zai provider [1 participants]