vllm - 💡(How to fix) Fix [Doc]:vllm可以支持在5090上部署么？？大家用的都是什么cuda配置啊 [4 comments, 4 participants]

TL;DR

Check the official documentation for VLLM deployment requirements and supported CUDA configurations.

Guidance

• Review the VLLM documentation to see if it explicitly states support for deployment on 5090.
• Search for existing issues or forum discussions related to VLLM deployment on 5090 to see if other users have found workarounds or solutions.
• Check the system requirements for VLLM to ensure that 5090 meets the minimum specifications for deployment.
• If possible, test VLLM deployment on a different environment to isolate if the issue is specific to 5090.

Notes

The provided information lacks technical details about the issue, so a definitive fix cannot be determined.

Recommendation

Apply workaround: Check the official documentation and search for existing issues to find potential workarounds for deploying VLLM on 5090, as there is not enough information to suggest a specific fix.