ollama - 💡(How to fix) Fix Add flag to the install script to skip NVIDIA/CUDA and force Vulkan or CPU-only [1 participants]

TL;DR

Adding a flag to the install script, such as --vulkan or --skip-nvidia, would allow users to manually select the backend and avoid unnecessary CUDA downloads.

Guidance

• Consider modifying the install.sh script to include a flag for manually selecting the backend, such as --vulkan or --skip-nvidia.
• Evaluate the current detection logic to determine why it's assuming an NVIDIA setup even when the user intends to use Vulkan or CPU.
• Test the proposed flag with various environments, including Fedora Silverblue (Toolbox) and SteamOS, to ensure compatibility.
• Document the new flag and its usage, such as curl -fsSL https://ollama.com/install.sh | sh -s -- --vulkan, to inform users of the new functionality.

Example

# Proposed example usage
curl -fsSL https://ollama.com/install.sh | sh -s -- --vulkan

Notes

The implementation of the flag would require modifications to the install.sh script, and thorough testing would be necessary to ensure the flag works as expected in different environments.

Recommendation

Apply workaround: Add a flag to the install script to allow manual selection of the backend, as this would provide users with more control over the installation process and improve compatibility with restricted environments.