TL;DR

The install script should be modified to check for AMD hardware even if an NVIDIA GPU is detected, to support hybrid systems with both AMD and NVIDIA GPUs.

Guidance

• The current script exits immediately after detecting an NVIDIA GPU, preventing it from checking for AMD hardware. This logic should be revised to continue checking for other GPUs.
• The script should be updated to download and extract the ollama-linux-<arch>-rocm package when an AMD GPU is detected, regardless of the presence of an NVIDIA GPU.
• Consider adding documentation to clearly outline the installation process for hybrid systems, including any required manual steps.
• To verify the fix, test the install script on a hybrid system with both AMD and NVIDIA GPUs, ensuring that it correctly detects and installs the necessary packages for both GPUs.

Example

# Pseudocode example of revised logic
if nvidia-smi is available; then
  print "NVIDIA GPU installed."
  # Do not exit, continue to check for AMD hardware
fi

if amd hardware is detected; then
  download and extract ollama-linux-${ARCH}-rocm package
fi

Notes

The provided solution assumes that the install script is the primary point of failure and that modifying it will resolve the issue. However, without the actual script code, this is an educated guess based on the described behavior.

Recommendation

Apply workaround: Modify the install script to continue checking for AMD hardware even after detecting an NVIDIA GPU, to ensure proper installation on hybrid systems. This approach directly addresses the described issue and provides a clear path to resolving the problem.