vllm - 💡(How to fix) Fix [CI Failure]: mi250_1: Multi-Modal Models (Standard) 4: other + whisper [2 comments, 1 participants]

TL;DR

The most likely fix involves investigating and resolving the issues with the mi250_1 hardware, which is currently failing, to get the Multi-Modal Models test group passing again.

Guidance

• Investigate the mi250_1 hardware status to determine the cause of the failure, checking for any recent changes or updates that may have caused the issue.
• Review the test results and logs from the latest nightly build (#7791) to identify any specific errors or patterns that could indicate the root cause of the failure.
• Check the sync_ready_tickets.py script to ensure it is correctly managing the test group and hardware status, and consider running it manually to see if it resolves any issues.
• Verify that the test group is passing on all other AMD hardware to isolate the issue to the mi250_1 hardware.

Notes

The issue seems to be specific to the mi250_1 hardware, and resolving the issue may require hardware-specific troubleshooting or configuration changes.

Recommendation

Apply workaround: Investigate and resolve the mi250_1 hardware issues, as it is the most likely cause of the test group failure, and ensure that the sync_ready_tickets.py script is correctly managing the test group and hardware status.