pytorch - ✅(Solved) Fix DISABLED test_get_memory_stats (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
pytorch/pytorch#180009Fetched 2026-04-11 06:10:18
View on GitHub
Comments
1
Participants
2
Timeline
52
Reactions
0
Author
Timeline (top)
mentioned ×21subscribed ×21labeled ×7unlabeled ×2

Root Cause

This test was disabled because it is failing on main branch (recent examples).

PR fix notes

PR #180547: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)

PR #180693: Conditionally skipped NCCL suspend/get_memory_stats/resume tests for NCCL lower than 2.29.7

Description (problem / solution / changelog)

Added conditional skips for test_suspend, test_get_memory_stats and test_resume for NCCL lower than 2.29.7

Fixes: #180009 Fixes: #179953 Fixes: #179950

Changed files

  • test/distributed/test_c10d_nccl.py (modified, +10/-3)
RAW_BUFFERClick to expand / collapse

Platforms: rocm

This test was disabled because it is failing on main branch (recent examples).

cc @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k @msaroufim @dcci @aditvenk @xmfan @jeffdaily @sunway513 @jithunnair-amd @pruthvistony @ROCmSupport @jataylo @hongxiayang @naromero77amd @jerrymannil @xinyazhang

extent analysis

TL;DR

The test test_get_memory_stats in test_c10d_nccl.py is failing on the main branch and needs to be investigated and fixed.

Guidance

  • Investigate the recent failures on torch-ci.com to understand the error messages and stack traces.
  • Check the test case test_get_memory_stats in test_c10d_nccl.py to see if there are any issues with the test itself or its dependencies.
  • Verify if the issue is specific to the rocm platform or if it's a general problem.
  • Reach out to the listed maintainers and experts for additional guidance and support.

Notes

The issue lacks detailed information about the error messages, stack traces, or any recent changes that might have caused the test to fail, making it difficult to provide a more specific fix or workaround.

Recommendation

Apply workaround: Investigate and fix the test case test_get_memory_stats in test_c10d_nccl.py to resolve the issue, as the test is currently disabled due to failures on the main branch.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

pytorch - ✅(Solved) Fix DISABLED test_get_memory_stats (__main__.ProcessGroupNCCLGroupTest) [2 pull requests, 1 comments, 2 participants]