Issue Station
Sign In
Tools hereToolbox

pytorch - ✅(Solved) Fix DISABLED test_suspend (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
pytorch/pytorch#179950•Fetched 2026-04-11 06:11:23
View on GitHub
Comments
1
Participants
2
Timeline
48
Reactions
0
Author
praguptapragupta
Participants
praguptapraguptapytorch-bot[bot]pytorch-bot[bot]
Timeline (top)
mentioned ×21subscribed ×21labeled ×5commented ×1

Root Cause

This test was disabled because it is failing on main branch (recent examples).

PR fix notes

PR #180547: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)

PR #180693: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)
RAW_BUFFERClick to expand / collapse

Platforms: rocm

This test was disabled because it is failing on main branch (recent examples).

cc @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k @msaroufim @dcci @aditvenk @xmfan @jeffdaily @sunway513 @jithunnair-amd @pruthvistony @ROCmSupport @jataylo @hongxiayang @naromero77amd @jerrymannil @xinyazhang

extent analysis

TL;DR

The test test_suspend in test_c10d_nccl.py needs to be investigated and fixed to resolve the failure on the main branch.

Guidance

  • Investigate the recent failures on torch-ci.com to understand the error messages and stack traces.
  • Review the test_suspend method in test_c10d_nccl.py to identify potential issues with the test case.
  • Check the NCCL configuration and version to ensure compatibility with the current setup.
  • Consider re-enabling the test and running it locally to reproduce and debug the issue.

Notes

The root cause of the issue is unclear without more information about the error messages and stack traces.

Recommendation

Apply workaround: Re-enable the test, run it locally, and debug the issue to identify the root cause and apply a fix.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#agent execution#callback error#memory management#API rate limit#retriever error

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

pytorch - ✅(Solved) Fix DISABLED test_suspend (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]