Issue Station
Sign In
Tools hereToolbox

vllm - 💡(How to fix) Fix [CI Failure]: mi355_1: Entrypoints Integration (API Server openai - Part 3) [2 comments, 1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
vllm-project/vllm#41582•Fetched 2026-05-04 04:58:39
View on GitHub
Comments
2
Participants
1
Timeline
8
Reactions
0
Author
AndreasKaratzasAndreasKaratzas
Participants
AndreasKaratzasAndreasKaratzas
Timeline (top)
added_to_project_v2 ×2commented ×2labeled ×1mentioned ×1

Root Cause

  • Flaky test
  • Can reproduce locally
  • Caused by external libraries (e.g. bug in transformers)

Code Example

FAILED entrypoints/openai/realtime/test_realtime_validation.py::test_multi_chunk_streaming[mistralai/Voxtral-Mini-4B-Realtime-2602]
FAILED entrypoints/openai/test_run_batch.py::test_completions_invalid_input
RAW_BUFFERClick to expand / collapse

Name of failing test

(command rocm-smi || true) && export VLLM_TEST_GROUP_NAME=mi355_1-entrypoints-integration-api-server-openai---part-3 && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests && export VLLM_WORKER_MULTIPROC_METHOD=spawn && pytest -v -s entrypoints/openai --ignore=entrypoints/openai/chat_completion/test_audio.py --ignore=entrypoints/openai/completion/test_shutdown.py --ignore=entrypoints/openai/test_completion.py --ignore=entrypoints/openai/models/test_models.py --ignore=entrypoints/openai/test_return_tokens_as_ids.py --ignore=entrypoints/openai/chat_completion/test_root_path.py --ignore=entrypoints/openai/completion/test_prompt_validation.py --ignore=entrypoints/openai/chat_completion --ignore=entrypoints/openai/completion --ignore=entrypoints/openai/speech_to_text/ --ignore=entrypoints/openai/correctness/ --ignore=entrypoints/openai/tool_parsers/ --ignore=entrypoints/openai/responses --ignore=entrypoints/openai/test_multi_api_servers.py

Basic information

  • Flaky test
  • Can reproduce locally
  • Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

FAILED entrypoints/openai/realtime/test_realtime_validation.py::test_multi_chunk_streaming[mistralai/Voxtral-Mini-4B-Realtime-2602]
FAILED entrypoints/openai/test_run_batch.py::test_completions_invalid_input

📝 History of failing test

  • Current streak start: 2026-04-03
  • First failure in 60d window: 2026-04-03
  • Last successful nightly: —
  • Break frequency (60d, pass↔fail flips): 0
  • Latest nightly date: 2026-05-03
  • Latest build(s): amd-ci #8177
  • Latest hardware status: mi355_1=fail

extent analysis

TL;DR

Investigate and fix the issues in test_realtime_validation.py and test_run_batch.py to resolve the failing tests.

Guidance

  • Review the test cases test_multi_chunk_streaming in test_realtime_validation.py and test_completions_invalid_input in test_run_batch.py to identify the cause of the failures.
  • Check the input data and parameters used in these tests to ensure they are valid and correctly formatted.
  • Verify that the mistralai/Voxtral-Mini-4B-Realtime-2602 model is properly configured and loaded in the test environment.
  • Run the tests individually to isolate the issue and gather more detailed error messages or logs.

Example

No code snippet is provided as the issue does not contain sufficient information to create a specific example.

Notes

The issue seems to be related to specific test cases and models, so the solution may require modifications to the test code or the model configuration. Further investigation is needed to determine the root cause of the failures.

Recommendation

Apply workaround: Investigate and fix the issues in the specific test cases to resolve the failing tests, as the problem seems to be related to the test code or model configuration rather than a general issue that could be resolved by upgrading to a fixed version.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#ssr#installation#tensor shape#request timeout

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

vllm - 💡(How to fix) Fix [CI Failure]: mi355_1: Entrypoints Integration (API Server openai - Part 3) [2 comments, 1 participants]