pytorch - 💡(How to fix) Fix DISABLED test_with_mode (__main__.TestTorchFunctionMode) [2 comments, 1 participants]

Traceback (most recent call last): File "/opt/conda/envs/py_3.14/lib/python3.14t/unittest/case.py", line 58, in testPartExecutor yield File "/opt/conda/envs/py_3.14/lib/python3.14t/unittest/case.py", line 669, in run self._callTestMethod(testMethod) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14t/unittest/case.py", line 615, in _callTestMethod result = method() File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/testing/_internal/common_utils.py", line 3528, in wrapper method(*args, **kwargs) ~~~~~~^^^^^^^^^^^^^^^^^ File "/var/lib/jenkins/workspace/test/test_overrides.py", line 1493, in test_with_mode class ErrorA(RuntimeError): File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 2506, in call result = self._torchdynamo_orig_backend( frame, cache_entry, self.hooks, frame_state, skip=1 ) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 2217, in call result = self._inner_convert( frame, cache_entry, hooks, frame_state, skip=skip + 1 ) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 772, in call result = _compile( frame.f_code, ...<18 lines>... convert_frame_box=self._box, ) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 2001, in _compile guarded_code, tracer_output = compile_inner(code, one_graph, hooks) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_utils_internal.py", line 96, in wrapper_function return function(*args, **kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 1611, in compile_inner result = _compile_inner(code, one_graph, hooks) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 1670, in _compile_inner dynamo_output = compile_frame( code, ...<11 lines>... package=package, ) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 1516, in compile_frame bytecode, tracer_output = transform_code_object(code, transform) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/bytecode_transformation.py", line 1626, in transform_code_object tracer_output = transformations(instructions, code_options) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 1488, in transform tracer_output = trace_frame( code, ...<14 lines>... package=package, ) File "/opt/conda/envs/py_3.14/lib/python3.14t/site-packages/torch/_dynamo/convert_frame.py", line 390, in _fn assert guards.check(), ( ~~~~~~~~~~~~^^ AssertionError: Global torch_function state changed while dynamo tracing, please report a bug

To execute this test, run the following from the base repo dir: PYTORCH_TEST_WITH_DYNAMO=1 python test/test_overrides.py TestTorchFunctionMode.test_with_mode

This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0

TL;DR

The most likely fix involves investigating and addressing the AssertionError caused by a change in global torch_function state during dynamo tracing.

Guidance

• Investigate the AssertionError exception in the stacktrace to understand why the global torch_function state is changing during dynamo tracing.
• Review the test case test_with_mode in test_overrides.py to identify potential issues with the test or the dynamo tracing configuration.
• Run the test with the provided command PYTORCH_TEST_WITH_DYNAMO=1 python test/test_overrides.py TestTorchFunctionMode.test_with_mode to reproduce the issue and gather more information.
• Check the PyTorch documentation and issues for known problems related to dynamo tracing and global torch_function state changes.

Example

No specific code example is provided as the issue requires further investigation into the PyTorch dynamo tracing and test configuration.

Notes

The provided stacktrace and error message suggest a complex issue related to PyTorch's dynamo tracing and test configuration. Further investigation is required to identify the root cause and develop a fix.

Recommendation

Apply a workaround by reconfiguring the test or dynamo tracing settings to prevent the global torch_function state change, if possible, until a permanent fix is available.