Issue Station
Sign In
Tools hereToolbox

vllm - 💡(How to fix) Fix [CI Failure]: mi250_2: Distributed DP Tests (2 GPUs) [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
vllm-project/vllm#40478•Fetched 2026-04-22 07:45:18
View on GitHub
Comments
0
Participants
1
Timeline
7
Reactions
0
Author
AndreasKaratzasAndreasKaratzas
Participants
AndreasKaratzasAndreasKaratzas
Timeline (top)
project_v2_item_status_changed ×3added_to_project_v2 ×2closed ×1labeled ×1
RAW_BUFFERClick to expand / collapse

AMD nightly — failing test group

Group: mi250_2: Distributed DP Tests (2 GPUs)

Current streak start: 2026-04-21 First failure in 60d window: 2026-04-21 Last successful nightly: 2026-04-20 Break frequency (60d, pass↔fail flips): 1 Latest nightly date: 2026-04-21 Latest build(s): amd-ci #7854

Hardware status in latest nightly

hardwarestatus
mi250_2fail

Auto-managed by sync_ready_tickets.py. Closed + moved to Done when this group passes on all AMD hardware.

Last sync: https://github.com/AndreasKaratzas/vllm-ci-dashboard/actions/runs/24731404470

extent analysis

TL;DR

Investigate the mi250_2: Distributed DP Tests (2 GPUs) group to identify the cause of the test failure.

Guidance

  • Review the build logs from amd-ci #7854 to identify potential error messages or stack traces related to the test failure.
  • Check the test configuration and environment for the mi250_2 hardware to ensure it matches the expected setup.
  • Run the failed test group locally or on a similar environment to reproduce and debug the issue.
  • Verify that the sync_ready_tickets.py script is correctly updating the ticket status based on the test results.

Notes

The issue seems to be related to a specific test group and hardware configuration, so the solution may involve hardware-specific fixes or test configuration changes.

Recommendation

Apply workaround: Investigate and debug the test failure to identify the root cause, as there is no clear indication of a version upgrade being necessary.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#model save/load#optimization#mixed precision#training loop#device allocation

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

vllm - 💡(How to fix) Fix [CI Failure]: mi250_2: Distributed DP Tests (2 GPUs) [1 participants]