vllm - 💡(How to fix) Fix [CI Failure]: Plugin Tests (2 GPUs) [1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
vllm-project/vllm#40111Fetched 2026-04-18 05:52:32
View on GitHub
Comments
0
Participants
1
Timeline
2
Reactions
0
Participants
Timeline (top)
added_to_project_v2 ×1labeled ×1

Error Message

[2026-04-17T04:39:06Z] ret = requests.post( [2026-04-17T04:39:06Z] server.url_for("pooling"), [2026-04-17T04:39:06Z] json=request_payload_url, [2026-04-17T04:39:06Z] ) [2026-04-17T04:39:06Z] [2026-04-17T04:39:06Z] response = ret.json() [2026-04-17T04:39:06Z] [2026-04-17T04:39:06Z] # verify the request response is in the correct format [2026-04-17T04:39:06Z] > assert (parsed_response := IOProcessorResponse(**response)) [2026-04-17T04:39:06Z] E pydantic_core._pydantic_core.ValidationError: 1 validation error for IOProcessorResponse [2026-04-17T04:39:06Z] E data [2026-04-17T04:39:06Z] E Field required [type=missing, input_value={'error': {'message': "'I...am': None, 'code': 500}}, input_type=dict] [2026-04-17T04:39:06Z] E For further information visit https://errors.pydantic.dev/2.12/v/missing [2026-04-17T04:39:06Z] [2026-04-17T04:39:06Z] plugins_tests/test_terratorch_io_processor_plugins.py:92: ValidationError

Root Cause

  • Flaky test
  • Can reproduce locally
  • Caused by external libraries (e.g. bug in transformers)

Code Example

plugins_tests/test_terratorch_io_processor_plugins.py:test_prithvi_mae_plugin_online[ibm-nasa-geospatial/Prithvi-EO-2.0-300M-BurnScars-https://huggingface.co/ibm-nasa-geospatial/Prithvi-EO-2.0-300M-BurnScars/resolve/main/examples/subsetted_512x512_HLS.S30.T10SEH.2018190.v1.4_merged.tif-prithvi_to_tiff-c07f4f602da73552] _

---

[2026-04-17T04:39:06Z]         ret = requests.post(
[2026-04-17T04:39:06Z]             server.url_for("pooling"),
[2026-04-17T04:39:06Z]             json=request_payload_url,
[2026-04-17T04:39:06Z]         )
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z]         response = ret.json()
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z]         # verify the request response is in the correct format
[2026-04-17T04:39:06Z] >       assert (parsed_response := IOProcessorResponse(**response))
[2026-04-17T04:39:06Z] E       pydantic_core._pydantic_core.ValidationError: 1 validation error for IOProcessorResponse
[2026-04-17T04:39:06Z] E       data
[2026-04-17T04:39:06Z] E         Field required [type=missing, input_value={'error': {'message': "'I...am': None, 'code': 500}}, input_type=dict]
[2026-04-17T04:39:06Z] E           For further information visit https://errors.pydantic.dev/2.12/v/missing
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z] plugins_tests/test_terratorch_io_processor_plugins.py:92: ValidationError
RAW_BUFFERClick to expand / collapse

Name of failing test

plugins_tests/test_terratorch_io_processor_plugins.py:test_prithvi_mae_plugin_online[ibm-nasa-geospatial/Prithvi-EO-2.0-300M-BurnScars-https://huggingface.co/ibm-nasa-geospatial/Prithvi-EO-2.0-300M-BurnScars/resolve/main/examples/subsetted_512x512_HLS.S30.T10SEH.2018190.v1.4_merged.tif-prithvi_to_tiff-c07f4f602da73552] _

Basic information

  • Flaky test
  • Can reproduce locally
  • Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

Plugin Tests (2 GPUs) fails with

[2026-04-17T04:39:06Z]         ret = requests.post(
[2026-04-17T04:39:06Z]             server.url_for("pooling"),
[2026-04-17T04:39:06Z]             json=request_payload_url,
[2026-04-17T04:39:06Z]         )
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z]         response = ret.json()
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z]         # verify the request response is in the correct format
[2026-04-17T04:39:06Z] >       assert (parsed_response := IOProcessorResponse(**response))
[2026-04-17T04:39:06Z] E       pydantic_core._pydantic_core.ValidationError: 1 validation error for IOProcessorResponse
[2026-04-17T04:39:06Z] E       data
[2026-04-17T04:39:06Z] E         Field required [type=missing, input_value={'error': {'message': "'I...am': None, 'code': 500}}, input_type=dict]
[2026-04-17T04:39:06Z] E           For further information visit https://errors.pydantic.dev/2.12/v/missing
[2026-04-17T04:39:06Z]
[2026-04-17T04:39:06Z] plugins_tests/test_terratorch_io_processor_plugins.py:92: ValidationError

This looks like a bad response/no response from the server, but more investigation is needed.

📝 History of failing test

Not failed in previous nightly.

CC List.

No response

extent analysis

TL;DR

The test failure is likely due to a validation error caused by a missing required field in the server response, which can be mitigated by checking the server response for errors before attempting to parse it.

Guidance

  • Investigate the server response to determine why the required data field is missing and instead contains an error object with a 500 status code.
  • Modify the test to check the server response for errors before attempting to parse it as an IOProcessorResponse.
  • Verify that the server is correctly handling the request and returning the expected response format.
  • Consider adding error handling to the test to account for potential server errors and provide more informative error messages.

Notes

The exact cause of the server error is unclear and requires further investigation, but it appears to be related to the server returning an error response instead of the expected data.

Recommendation

Apply workaround: Modify the test to check the server response for errors before attempting to parse it, to prevent validation errors and provide more informative error messages.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

vllm - 💡(How to fix) Fix [CI Failure]: Plugin Tests (2 GPUs) [1 participants]