Issue Station
Sign In
Tools hereToolbox

vllm - ✅(Solved) Fix [Bug]: Qwen3.5-35B-A3B FlashInfer JIT compilation fails with C++17 feature errors (e.g., std::is_unsigned_v) when using vLLM 0.17.0 [1 pull requests, 3 comments, 3 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
vllm-project/vllm#36584•Fetched 2026-04-08 00:36:12
View on GitHub
Comments
3
Participants
3
Timeline
7
Reactions
0
Author
FLCgeigeiFLCgeigei
Participants
FLCgeigeiFLCgeigeihaosdenthaosdentZJY0516ZJY0516
Timeline (top)
commented ×3closed ×1cross-referenced ×1labeled ×1

Error Message

sec-agentic-rag-judge2-blue-t70348fbbb7d-master-0:%!(EXTRA string=(EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_standard_layout_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(145): error: namespace "std" has no member "is_unsigned_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_unsigned_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(147): error: namespace "std" has no member "is_signed_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_signed_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(157): error: namespace "std" has no member "is_empty_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_empty_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(159): error: namespace "std" has no member "invoke_result_t" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::invoke_result_t; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(171): error: namespace "std" has no member "alignment_of_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::alignment_of_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(174): error: namespace "std" has no member "is_pointer_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_pointer_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: identifier "is_lvalue_reference_v" is undefined (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^

Root Cause

sec-agentic-rag-judge2-blue-t70348fbbb7d-master-0:%!(EXTRA string=(EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_standard_layout_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(145): error: namespace "std" has no member "is_unsigned_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_unsigned_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(147): error: namespace "std" has no member "is_signed_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_signed_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(157): error: namespace "std" has no member "is_empty_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_empty_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(159): error: namespace "std" has no member "invoke_result_t" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::invoke_result_t; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(171): error: namespace "std" has no member "alignment_of_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::alignment_of_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(174): error: namespace "std" has no member "is_pointer_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_pointer_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: identifier "is_lvalue_reference_v" is undefined (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: type name is not allowed (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: expected an expression (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: namespace "std" has no member "is_same_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: pack expansion does not make use of any argument packs (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: fold expression does not refer to a parameter pack (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a ")" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: template parameter "Us" may not be redeclared in this scope (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: a constexpr static data member declaration requires an in-class initializer (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a ";" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a "}" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(314): note #3196-D: to match this "{" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] struct is_any_of { (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] 33 errors detected in the compilation of "/home/jovyan/.cache/flashinfer/0.6.4/90a/generated/gdn_prefill_sm90/gdn_prefill_kernel_half_g0b1a0i0.cu". (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ninja: build stopped: subcommand failed. (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ', please check the stack trace above for the root cause (Worker pid=426) (Worker_TP1 pid=426) INFO 03-10 11:46:00 [multiproc_executor.py:749] Parent process exited, terminating worker (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] AsyncLLM output_handler failed. (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] Traceback (most recent call last): (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/vllm/v1/engine/async_llm.py", line 664, in output_handler (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] outputs = await engine_core.get_output_async() (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/vllm/v1/engine/core_client.py", line 1009, in get_output_async (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] raise self._format_exception(outputs) from None (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] vllm.v1.engine.exceptions.EngineDeadError: EngineCore encountered an issue. See stack trace (above) for the root cause. (Worker pid=425) (Worker_TP0 pid=425) INFO 03-10 11:46:00 [multiproc_executor.py:749] Parent process exited, terminating worker (APIServer pid=20) INFO: 10.244.170.101:45088 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=425) (Worker_TP0 pid=425) INFO 03-10 11:46:01 [multiproc_executor.py:802] WorkerProc shutting down. (Worker pid=426) (Worker_TP1 pid=426) INFO 03-10 11:46:01 [multiproc_executor.py:802] WorkerProc shutting down. (APIServer pid=20) INFO: 10.244.60.13:38674 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=426) (Worker_TP1 pid=426) Exception ignored in: <function AllReduceFusionWorkspace.del at 0x7fc4d22851c0> (Worker pid=426) (Worker_TP1 pid=426) Traceback (most recent call last): (Worker pid=426) (Worker_TP1 pid=426) File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/flashinfer/comm/workspace_base.py", line 72, in del (Worker pid=426) (Worker_TP1 pid=426) ImportError: sys.meta_path is None, Python is likely shutting down (APIServer pid=20) INFO: 10.244.40.152:42800 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=425) (Worker_TP0 pid=425) Exception ignored in: <function AllReduceFusionWorkspace.del at 0x7f73889991c0> (Worker pid=425) (Worker_TP0 pid=425) Traceback (most recent call last): (Worker pid=425) (Worker_TP0 pid=425) File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/flashinfer/comm/workspace_base.py", line 72, in del (Worker pid=425) (Worker_TP0 pid=425) ImportError: sys.meta_path is None, Python is likely shutting down )

Fix Action

Fixed

PR fix notes

PR #36647: [GDN] add a config for gdn kernel selection

Description (problem / solution / changelog)

Purpose

Fix https://github.com/vllm-project/vllm/issues/36584 Although the GDN kernel offers better performance, it requires C++17 for JIT compilation. So we've added a switching mechanism here to handle it.

vllm serve --gdn-prefill-backend flashinfer
vllm serve --gdn-prefill-backend triton

Test Plan

Test Result

<details> <summary> Essential Elements of an Effective PR Description Checklist </summary>
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.
</details>

Changed files

  • vllm/engine/arg_utils.py (modified, +11/-0)
  • vllm/model_executor/models/qwen3_next.py (modified, +36/-4)

Code Example

Your output of `python collect_env.py` here
RAW_BUFFERClick to expand / collapse

Your current environment

<details> <summary>The output of <code>python collect_env.py</code></summary> 
Your output of `python collect_env.py` here
</details>

🐛 Describe the bug

sec-agentic-rag-judge2-blue-t70348fbbb7d-master-0:%!(EXTRA string=(EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_standard_layout_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(145): error: namespace "std" has no member "is_unsigned_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_unsigned_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(147): error: namespace "std" has no member "is_signed_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_signed_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(157): error: namespace "std" has no member "is_empty_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_empty_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(159): error: namespace "std" has no member "invoke_result_t" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::invoke_result_t; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(171): error: namespace "std" has no member "alignment_of_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::alignment_of_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(174): error: namespace "std" has no member "is_pointer_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] using std::is_pointer_v; (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: identifier "is_lvalue_reference_v" is undefined (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: type name is not allowed (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(190): error: expected an expression (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] static_assert(! is_lvalue_reference_v<T>, "T cannot be an lvalue reference (e.g., U&)."); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: namespace "std" has no member "is_same_v" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: pack expansion does not make use of any argument packs (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: fold expression does not refer to a parameter pack (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a ")" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: template parameter "Us" may not be redeclared in this scope (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: a constexpr static data member declaration requires an in-class initializer (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a ";" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(315): error: expected a "}" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] constexpr static bool value = (... || std::is_same_v<T, Us>); (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] /home/jovyan/.conda/envs/vllm0170/lib/python3.13/site-packages/flashinfer/data/cutlass/include/cute/util/type_traits.hpp(314): note #3196-D: to match this "{" (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] struct is_any_of { (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ^ (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] 33 errors detected in the compilation of "/home/jovyan/.cache/flashinfer/0.6.4/90a/generated/gdn_prefill_sm90/gdn_prefill_kernel_half_g0b1a0i0.cu". (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ninja: build stopped: subcommand failed. (EngineCore_DP0 pid=227) ERROR 03-10 11:46:00 [core.py:1102] ', please check the stack trace above for the root cause (Worker pid=426) (Worker_TP1 pid=426) INFO 03-10 11:46:00 [multiproc_executor.py:749] Parent process exited, terminating worker (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] AsyncLLM output_handler failed. (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] Traceback (most recent call last): (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/vllm/v1/engine/async_llm.py", line 664, in output_handler (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] outputs = await engine_core.get_output_async() (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/vllm/v1/engine/core_client.py", line 1009, in get_output_async (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] raise self._format_exception(outputs) from None (APIServer pid=20) ERROR 03-10 11:46:00 [async_llm.py:708] vllm.v1.engine.exceptions.EngineDeadError: EngineCore encountered an issue. See stack trace (above) for the root cause. (Worker pid=425) (Worker_TP0 pid=425) INFO 03-10 11:46:00 [multiproc_executor.py:749] Parent process exited, terminating worker (APIServer pid=20) INFO: 10.244.170.101:45088 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=425) (Worker_TP0 pid=425) INFO 03-10 11:46:01 [multiproc_executor.py:802] WorkerProc shutting down. (Worker pid=426) (Worker_TP1 pid=426) INFO 03-10 11:46:01 [multiproc_executor.py:802] WorkerProc shutting down. (APIServer pid=20) INFO: 10.244.60.13:38674 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=426) (Worker_TP1 pid=426) Exception ignored in: <function AllReduceFusionWorkspace.del at 0x7fc4d22851c0> (Worker pid=426) (Worker_TP1 pid=426) Traceback (most recent call last): (Worker pid=426) (Worker_TP1 pid=426) File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/flashinfer/comm/workspace_base.py", line 72, in del (Worker pid=426) (Worker_TP1 pid=426) ImportError: sys.meta_path is None, Python is likely shutting down (APIServer pid=20) INFO: 10.244.40.152:42800 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error (Worker pid=425) (Worker_TP0 pid=425) Exception ignored in: <function AllReduceFusionWorkspace.del at 0x7f73889991c0> (Worker pid=425) (Worker_TP0 pid=425) Traceback (most recent call last): (Worker pid=425) (Worker_TP0 pid=425) File "/home/jovyan/anaconda3/envs/vllm0170_py312/lib/python3.12/site-packages/flashinfer/comm/workspace_base.py", line 72, in del (Worker pid=425) (Worker_TP0 pid=425) ImportError: sys.meta_path is None, Python is likely shutting down )

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

extent analysis

Fix Plan

The issue seems to be related to missing type traits in the C++ code. To fix this, we need to ensure that the C++ code is compatible with the version of the C++ standard being used.

Here are the steps to fix the issue:

  • Check the version of the C++ standard being used. If it's older than C++17, update it to C++17 or later.
  • Include the necessary headers for the type traits. For example, to use std::is_unsigned_v, std::is_signed_v, std::is_empty_v, std::invoke_result_t, std::alignment_of_v, std::is_pointer_v, and std::is_same_v, include the <type_traits> header.
  • If the issue persists, check if the type traits are being used correctly.

Example code:

#include <type_traits>

// Example usage of std::is_unsigned_v
static_assert(std::is_unsigned_v<unsigned int>, "unsigned int is not unsigned");

// Example usage of std::is_signed_v
static_assert(std::is_signed_v<int>, "int is not signed");

// Example usage of std::is_empty_v
static_assert(std::is_empty_v<std::tuple<>>, "std::tuple<> is not empty");

// Example usage of std::invoke_result_t
auto func = [](int x) { return x; };
using result_type = std::invoke_result_t<decltype(func), int>;
static_assert(std::is_same_v<result_type, int>, "result_type is not int");

// Example usage of std::alignment_of_v
static_assert(std::alignment_of_v<int> == alignof(int), "alignment of int is not correct");

// Example usage of std::is_pointer_v
static_assert(std::is_pointer_v<int*>, "int* is not a pointer");

// Example usage of std::is_same_v
static_assert(std::is_same_v<int, int>, "int is not the same as int");

Verification

To verify that the fix worked, recompile the code and check if the errors are resolved. If the errors persist, check the version of the C++ standard being used and the usage of the type traits.

Extra Tips

  • Make sure to include the necessary headers for the type traits.
  • Check the version of the C++ standard being used and update it if necessary.
  • Use static_assert to verify the correctness of the type traits usage.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#ssr#installation#tensor shape#autograd error#indexing error#inference speed#output truncation#response parsing

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

vllm - ✅(Solved) Fix [Bug]: Qwen3.5-35B-A3B FlashInfer JIT compilation fails with C++17 feature errors (e.g., std::is_unsigned_v) when using vLLM 0.17.0 [1 pull requests, 3 comments, 3 participants]