litellm - 💡(How to fix) Fix [Bug]: /health returns empty healthy_endpoints and unhealthy_endpoints for hosted_vllm models on v1.84.x

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

LiteLLM Version

v1.84.x

What happened?

/health returns:

json { "healthy_endpoints": [], "unhealthy_endpoints": [] }

for all hosted_vllm models.

However:

  • /v1/models works
  • /v1/model/info works
  • /v1/chat/completions works

The models are reachable and inference succeeds correctly.

Reproduction Steps

Configuration:

yaml model_list: - model_name: Gpt-oss-120b litellm_params: model: hosted_vllm/Gpt-oss-120b api_base: http://vllm:8000/v1

Health check:

bash curl "http://litellm:4000/health"

or

bash curl "http://litellm:4000/health?model=Gpt-oss-120b"

returns:

json { "healthy_endpoints": [], "unhealthy_endpoints": [] }

Expected Behavior

The endpoint should populate either:

  • healthy_endpoints
  • or unhealthy_endpoints

Relevant Logs

text GET /health?model=Gpt-oss-120b HTTP/1.1" 200 OK

No provider errors appear in the logs.

Additional Context

  • Self-hosted vLLM
  • HuggingFace weights
  • Inference works correctly through /v1/chat/completions
  • The issue started after upgrading from v1.80.0 to v1.84.x

Steps to Reproduce

Relevant log output

What part of LiteLLM is this about?

No response

What LiteLLM version are you on ?

v1.84.0

Twitter / LinkedIn details

No response

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING