pytorch - ✅(Solved) Fix DISABLED test_resume (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
pytorch/pytorch#179953Fetched 2026-04-11 06:11:18
View on GitHub
Comments
1
Participants
2
Timeline
48
Reactions
0
Timeline (top)
mentioned ×21subscribed ×21labeled ×5commented ×1

Root Cause

This test was disabled because it is failing on main branch (recent examples).

PR fix notes

PR #180547: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)

PR #180693: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)
RAW_BUFFERClick to expand / collapse

Platforms: rocm

This test was disabled because it is failing on main branch (recent examples).

cc @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k @pragupta @msaroufim @dcci @aditvenk @xmfan @jeffdaily @sunway513 @pruthvistony @ROCmSupport @jataylo @hongxiayang @naromero77amd @jerrymannil @xinyazhang

extent analysis

TL;DR

Enable the disabled test test_c10d_nccl.py and investigate the failure cause on the main branch.

Guidance

  • Investigate the recent examples of test failures on torch-ci.com to understand the failure patterns.
  • Review the test_c10d_nccl.py test code, specifically the ProcessGroupNCCLGroupTest and test_resume test case, to identify potential issues.
  • Check the test environment and configuration on the main branch to ensure it matches the expected setup.
  • Consider re-enabling the test and running it locally or on a CI environment to reproduce and debug the issue.

Notes

The issue lacks specific technical details about the failure, so a thorough investigation of the test code and environment is necessary to determine the root cause.

Recommendation

Apply workaround: Re-enable the test and investigate the failure cause, as the test was disabled due to failures on the main branch, and understanding the cause is essential to resolving the issue.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

pytorch - ✅(Solved) Fix DISABLED test_resume (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]