pytorch - 💡(How to fix) Fix DISABLED test_find_learning_rate_ensembling_AlphaDropout_mechanism_make_functional_cpu (__main__.TestExamplesCorrectnessCPU) [1 comments, 1 participants]

Traceback (most recent call last): File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4703, in test_find_learning_rate_ensembling class MLPClassifier(nn.Module): File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4725, in torch_dynamo_resume_in_test_find_learning_rate_ensembling_at_4703 MLPClassifier().to(device), mechanism File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4724, in torch_dynamo_resume_in_test_find_learning_rate_ensembling_at_4725 func_model, weights = _get_weights_and_functional_call( File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4754, in torch_dynamo_resume_in_test_find_learning_rate_ensembling_at_4724 batched_weights = init_fn(num_models=2) File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4745, in init_fn og_model = MLPClassifier().to(device) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 2474, in call result = self._torchdynamo_orig_backend( frame, cache_entry, self.hooks, frame_state, skip=1 ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 2192, in call result = self._inner_convert( frame, cache_entry, hooks, frame_state, skip=skip + 1 ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 736, in call result = _compile( frame.f_code, ...<16 lines>... convert_frame_box=self._box, ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 1961, in _compile guarded_code, tracer_output = compile_inner(code, one_graph, hooks) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_utils_internal.py", line 96, in wrapper_function return function(*args, **kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 1571, in compile_inner result = _compile_inner(code, one_graph, hooks) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 1630, in _compile_inner dynamo_output = compile_frame( code, ...<11 lines>... package=package, ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 1478, in compile_frame bytecode, tracer_output = transform_code_object(code, transform) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/bytecode_transformation.py", line 1626, in transform_code_object tracer_output = transformations(instructions, code_options) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 1450, in transform tracer_output = trace_frame( code, ...<14 lines>... package=package, ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 343, in _fn return fn(*args, **kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 911, in trace_frame run_tracer() ~~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/convert_frame.py", line 892, in run_tracer tracer.run() ~~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1829, in run while self.step(): ~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1496, in step self.dispatch_table[inst.opcode](self, inst) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1022, in wrapper return inner_fn(self, inst) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4187, in CALL self._call(inst) ~~~~~~~~~~^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4178, in _call self.call_function(fn, args, kwargs) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1397, in call_function self.push(fn.call_function(self, args, kwargs)) # type: ignore[arg-type] ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 1674, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 815, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 494, in call_function return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs) # type: ignore[attr-defined] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1424, in inline_user_function_return return InliningInstructionTranslator.inline_call(self, fn, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5258, in inline_call return tracer.inline_call() ~~~~~~~~~~~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5479, in inline_call self.run() ~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1829, in run while self.step(): ~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1496, in step self.dispatch_table[inst.opcode](self, inst) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1022, in wrapper return inner_fn(self, inst) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4187, in CALL self._call(inst) ~~~~~~~~~~^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4178, in _call self.call_function(fn, args, kwargs) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1397, in call_function self.push(fn.call_function(self, args, kwargs)) # type: ignore[arg-type] ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 1674, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 815, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 494, in call_function return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs) # type: ignore[attr-defined] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1424, in inline_user_function_return return InliningInstructionTranslator.inline_call(self, fn, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5258, in inline_call return tracer.inline_call() ~~~~~~~~~~~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5479, in inline_call self.run() ~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1829, in run while self.step(): ~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1496, in step self.dispatch_table[inst.opcode](self, inst) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1022, in wrapper return inner_fn(self, inst) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4187, in CALL self._call(inst) ~~~~~~~~~~^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 4178, in _call self.call_function(fn, args, kwargs) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1397, in call_function self.push(fn.call_function(self, args, kwargs)) # type: ignore[arg-type] ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 1674, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 815, in call_function return super().call_function(tx, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/functions.py", line 494, in call_function return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs) # type: ignore[attr-defined] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1424, in inline_user_function_return return InliningInstructionTranslator.inline_call(self, fn, args, kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5258, in inline_call return tracer.inline_call() ~~~~~~~~~~~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/dynamo/symbolic_convert.py", line 5479, in inline_call self.run() ~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1829, in run while self.step(): ~~~~~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1496, in step self.dispatch_table[inst.opcode](self, inst) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 1022, in wrapper return inner_fn(self, inst) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/symbolic_convert.py", line 2945, in STORE_ATTR VariableTracker.build(self, setattr).call_function( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ self, # type: ignore[arg-type] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [obj, VariableTracker.build(self, inst.argval), val], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ {}, ^^^ ) ^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builtin.py", line 1503, in call_function return handler(tx, args, kwargs) # type: ignore[return-value] File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builtin.py", line 1267, in builtin_dispatch rv = handler(tx, args, kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builtin.py", line 1141, in call_self_handler return self_handler(tx, args, **kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builtin.py", line 2707, in call_setattr out = wrap_fx_proxy( tx, ...<4 lines>... ), ) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builder.py", line 3084, in wrap_fx_proxy return wrap_fx_proxy_cls(target_cls=TensorVariable, **kwargs) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builder.py", line 3159, in wrap_fx_proxy_cls out: VTTypeAlias = _wrap_fx_proxy( ~~~~~~~~~~~~~~^ target_cls, tx, proxy, example_value, subclass_type, **options ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/variables/builder.py", line 3283, in _wrap_fx_proxy example_value = get_fake_value(proxy.node, tx, allow_non_graph_fake=True) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/utils.py", line 3752, in get_fake_value return _get_fake_value_impl(node, tx, allow_non_graph_fake) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/utils.py", line 3943, in _get_fake_value_impl _wrap_graph_break_with_torch_runtime_err( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ lambda: unimplemented( ^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... ) ^ ) ^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/utils.py", line 3741, in _wrap_graph_break_with_torch_runtime_err raise exc.with_traceback(e.traceback) from None File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/utils.py", line 3738, in _wrap_graph_break_with_torch_runtime_err gb_fn() ~~~~~^^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/utils.py", line 3944, in <lambda> lambda: unimplemented( ~~~~~~~~~~~~~^ gb_type="RuntimeError when making fake tensor call", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... from_exc=cause, ^^^^^^^^^^^^^^^ ) ^ File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/_dynamo/exc.py", line 653, in unimplemented raise Unsupported( msg, gb_type, skip_frame, real_stack=past_real_stack ) from from_exc torch.dynamo.exc.TorchRuntimeError: RuntimeError when making fake tensor call Explanation: Dynamo failed to run FX node with fake tensors: call_function <method 'set' of 'torch._C.TensorBase' objects>((Parameter(FakeTensor(..., size=(32, 16), requires_grad=True)), Parameter(FakeTensor(..., size=(32, 16), requires_grad=True))), **{}): got RuntimeError('tls_on_entry.has_value() INTERNAL ASSERT FAILED at "/__w/pytorch/pytorch/aten/src/ATen/core/PythonFallbackKernel.cpp":53, please report a bug to PyTorch. ') Hint: Your code may result in an error when running in eager. Please double check that your code doesn't contain a similar error when actually running eager/uncompiled. You can do this by removing the torch.compile call, or by using torch.compiler.set_stance("force_eager").

Developer debug context:

For more details about this graph break, please visit: https://meta-pytorch.github.io/compile-graph-break-site/gb/gb4315.html

from user code: File "/__w/pytorch/pytorch/test/functorch/test_eager_transforms.py", line 4745, in torch_dynamo_resume_in_init_fn_at_4745 og_model = MLPClassifier().to(device) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/nn/modules/module.py", line 1383, in to return self._apply(convert) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/nn/modules/module.py", line 933, in _apply module._apply(fn) File "/opt/conda/envs/py_3.14/lib/python3.14/site-packages/torch/nn/modules/module.py", line 995, in _apply param.data = param_applied

Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"

To execute this test, run the following from the base repo dir: PYTORCH_TEST_WITH_DYNAMO=1 python test/functorch/test_eager_transforms.py TestExamplesCorrectnessCPU.test_find_learning_rate_ensembling_AlphaDropout_mechanism_make_functional_cpu

This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0

TL;DR

The most likely fix for the failing test is to modify the code to handle the error when running in eager mode, potentially by removing the torch.compile call or using torch.compiler.set_stance("force_eager").

Guidance

• Review the test code in functorch/test_eager_transforms.py to identify the source of the error when running in eager mode.
• Consider removing the torch.compile call or using torch.compiler.set_stance("force_eager") to force the code to run in eager mode.
• Check the PyTorch documentation and the provided links for more information on debugging and fixing the issue.
• Set TORCHDYNAMO_VERBOSE=1 and TORCH_LOGS="+dynamo" to get more detailed internal stack traces and logs.

Example

No specific code example is provided, as the issue is related to a complex error in the PyTorch framework. However, the test can be executed using the provided command: PYTORCH_TEST_WITH_DYNAMO=1 python test/functorch/test_eager_transforms.py TestExamplesCorrectnessCPU.test_find_learning_rate_ensembling_AlphaDropout_mechanism_make_functional_cpu

Notes

The error message suggests that the issue is related to the torch.compile call and the use of fake tensors. The provided links and documentation may help in debugging and fixing the issue.

Recommendation

Apply a workaround by modifying the code to handle the error when running in eager mode, potentially by removing the torch.compile call or using torch.compiler.set_stance("force_eager"). This is because the error message suggests that the issue is related to the torch.compile call and the use of fake tensors, and modifying the code to handle this error may resolve the issue.