ollama - 💡(How to fix) Fix failure during GPU discovery with ROCm (crash) in ubuntu 26.04 and docker container [1 comments, 1 participants]

time=2026-04-23T01:57:05.334Z level=INFO source=runner.go:464 msg="failure during GPU discovery" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" extra_envs="map[GGML_CUDA_INIT:1 ROCR_VISIBLE_DEVICES:0]" error="runner crashed"

TL;DR

• Verify the compatibility of Ollama version 0.21.1 with the ROCm installation in the LXD container.

Guidance

• Check the official Ollama documentation for supported ROCm versions to ensure compatibility with version 0.21.1.
• Review the ROCm installation process to confirm that all necessary dependencies are installed and configured correctly.
• Consider checking the environment variables set by the extra_envs map, such as GGML_CUDA_INIT and ROCR_VISIBLE_DEVICES, to ensure they are correctly configured for the AMD GPU.

Example

• No specific code snippet is provided due to the lack of detailed information about the crash.

Notes

• The issue may be related to incompatibility between Ollama and ROCm, or incorrect configuration of environment variables.
• Further debugging information, such as the output of rocm-smi or rocminfo, may be necessary to determine the root cause of the issue.

Recommendation

• Apply workaround: Try setting the OLLLAMA_LIBRARY_PATH environment variable to a specific path, such as /usr/local/lib/ollama/rocm, to ensure that Ollama is using the correct ROCm libraries.