vllm - 💡(How to fix) Fix [Bug]: 在910b4上使用vLLM 部署 Qwen/Qwen3-VL-Reranker-2B报错 [2 comments, 3 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
vllm-project/vllm#36759Fetched 2026-04-08 00:35:00
View on GitHub
Comments
2
Participants
3
Timeline
4
Reactions
0
Timeline (top)
commented ×2closed ×1labeled ×1

Error Message

(EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] EngineCore failed to start. (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] Traceback (most recent call last): (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 937, in run_engine_core (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 691, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] super().init( (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 105, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model_executor = executor_class(vllm_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/executor/abstract.py", line 101, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self._init_executor() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/executor/uniproc_executor.py", line 48, in _init_executor (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.driver_worker.load_model() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker.py", line 429, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model_runner.load_model() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 2341, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model = get_model(vllm_config=self.vllm_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/init.py", line 135, in get_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] return loader.load_model( (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/base_loader.py", line 58, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.load_weights(model, model_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/default_loader.py", line 288, in load_weights (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] loaded_weights = model.load_weights(self.get_all_weights(model_config, model)) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 337, in load_weights (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] return seq_cls_model_loader(self, weights) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Code Example

Your output of `python collect_env.py` here
RAW_BUFFERClick to expand / collapse

Your current environment

<details> <summary>The output of <code>python collect_env.py</code></summary>
Your output of `python collect_env.py` here
</details>

🐛 Describe the bug

在昇腾910b4上使用vLLM 使用官方文档推荐的命令部署 Qwen/Qwen3-VL-Reranker-2B报错: 1、命令如下: vllm serve Qwen/Qwen3-VL-Reranker-2B
--runner pooling
--max-model-len 4096
--hf_overrides '{"architectures": ["Qwen3VLForSequenceClassification"],"classifier_from_token": ["no", "yes"],"is_original_qwen3_reranker": true}'
--chat-template examples/pooling/score/template/qwen3_vl_reranker.jinja 2、报错如下: (EngineCore_DP0 pid=1424) INFO 03-11 08:10:39 [compilation.py:863] Using OOT custom backend for compilation. Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s] Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 23.00it/s] (EngineCore_DP0 pid=1424) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] EngineCore failed to start. (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] Traceback (most recent call last): (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 937, in run_engine_core (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 691, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] super().init( (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 105, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model_executor = executor_class(vllm_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/executor/abstract.py", line 101, in init (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self._init_executor() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/v1/executor/uniproc_executor.py", line 48, in _init_executor (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.driver_worker.load_model() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker.py", line 429, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model_runner.load_model() (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 2341, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.model = get_model(vllm_config=self.vllm_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/init.py", line 135, in get_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] return loader.load_model( (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/base_loader.py", line 58, in load_model (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] self.load_weights(model, model_config) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/default_loader.py", line 288, in load_weights (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] loaded_weights = model.load_weights(self.get_all_weights(model_config, model)) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 337, in load_weights (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] return seq_cls_model_loader(self, weights) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 613, in seq_cls_model_loader (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] return SEQ_CLS_LOAD_METHODS[method](model, weights) (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 509, in load_weights_using_from_2_way_softmax (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] score_layer = language_model.score if is_vlm else model.score (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] ^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] File "/usr/local/python3.11.14/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1964, in getattr (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] raise AttributeError( (EngineCore_DP0 pid=1424) ERROR 03-11 08:10:43 [core.py:946] AttributeError: 'Qwen3LLMForCausalLM' object has no attribute 'score' (EngineCore_DP0 pid=1424) Process EngineCore_DP0: (EngineCore_DP0 pid=1424) Traceback (most recent call last): (EngineCore_DP0 pid=1424) File "/usr/local/python3.11.14/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap (EngineCore_DP0 pid=1424) self.run() (EngineCore_DP0 pid=1424) File "/usr/local/python3.11.14/lib/python3.11/multiprocessing/process.py", line 108, in run (EngineCore_DP0 pid=1424) self._target(*self._args, **self._kwargs) (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 950, in run_engine_core (EngineCore_DP0 pid=1424) raise e (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 937, in run_engine_core (EngineCore_DP0 pid=1424) engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 691, in init (EngineCore_DP0 pid=1424) super().init( (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 105, in init (EngineCore_DP0 pid=1424) self.model_executor = executor_class(vllm_config) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/executor/abstract.py", line 101, in init (EngineCore_DP0 pid=1424) self._init_executor() (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/v1/executor/uniproc_executor.py", line 48, in _init_executor (EngineCore_DP0 pid=1424) self.driver_worker.load_model() (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker.py", line 429, in load_model (EngineCore_DP0 pid=1424) self.model_runner.load_model() (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 2341, in load_model (EngineCore_DP0 pid=1424) self.model = get_model(vllm_config=self.vllm_config) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/model_loader/init.py", line 135, in get_model (EngineCore_DP0 pid=1424) return loader.load_model( (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/model_loader/base_loader.py", line 58, in load_model (EngineCore_DP0 pid=1424) self.load_weights(model, model_config) (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/model_loader/default_loader.py", line 288, in load_weights (EngineCore_DP0 pid=1424) loaded_weights = model.load_weights(self.get_all_weights(model_config, model)) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 337, in load_weights (EngineCore_DP0 pid=1424) return seq_cls_model_loader(self, weights) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 613, in seq_cls_model_loader (EngineCore_DP0 pid=1424) return SEQ_CLS_LOAD_METHODS[method](model, weights) (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/vllm-workspace/vllm/vllm/model_executor/models/adapters.py", line 509, in load_weights_using_from_2_way_softmax (EngineCore_DP0 pid=1424) score_layer = language_model.score if is_vlm else model.score (EngineCore_DP0 pid=1424) ^^^^^^^^^^^^^^^^^^^^ (EngineCore_DP0 pid=1424) File "/usr/local/python3.11.14/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1964, in getattr (EngineCore_DP0 pid=1424) raise AttributeError( (EngineCore_DP0 pid=1424) AttributeError: 'Qwen3LLMForCausalLM' object has no attribute 'score'

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

extent analysis

Fix Plan

The error message indicates that the Qwen3LLMForCausalLM object has no attribute score. To fix this issue, we need to modify the code to handle this missing attribute.

Here are the steps to fix the issue:

  • Modify the load_weights_using_from_2_way_softmax function in adapters.py to check if the score attribute exists before trying to access it.
  • If the score attribute does not exist, use an alternative approach to load the weights.

Example code:

def load_weights_using_from_2_way_softmax(self, model, weights):
    if hasattr(model, 'score'):
        score_layer = model.score
    else:
        # Alternative approach to load weights
        score_layer = None  # Replace with alternative logic
    # Rest of the function remains the same

Verification

To verify that the fix worked, run the vllm serve command again with the modified code. If the issue is resolved, the command should execute without errors.

Extra Tips

  • Make sure to test the modified code thoroughly to ensure that it works as expected.
  • If the alternative approach to load weights is not feasible, consider modifying the model architecture to include the score attribute.
  • Always check for the existence of attributes before trying to access them to avoid similar errors in the future.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING