ollama - 💡(How to fix) Fix ROCm on AMD Phoenix APUs (Radeon 780M iGPU) — HSA_OVERRIDE_GFX_VERSION required [2 comments, 2 participants]

This tells ROCm to treat the Phoenix APU as a supported gfx1100 target. Without it, the GPU sits idle — no error, no warning, just silent CPU fallback.

TL;DR

Setting the environment variable HSA_OVERRIDE_GFX_VERSION=11.0.0 allows Ollama to detect and utilize the integrated graphics on AMD Ryzen 7000/8000 series with Phoenix APUs.

Guidance

• To enable iGPU detection, set the HSA_OVERRIDE_GFX_VERSION environment variable to 11.0.0 before running Ollama.
• Ensure you have the rocm-libs installed, as this is required for the fix to work.
• Verify that the iGPU is being utilized by checking the performance improvement, such as the increased token per second (tok/s) rate.
• Consider adding a note to the Ollama documentation regarding the use of Phoenix APUs with ROCm/AMD to help other users.

Example

No explicit code example is provided, but the environment variable can be set using the command export HSA_OVERRIDE_GFX_VERSION=11.0.0 before running Ollama.

Notes

This fix is specific to AMD Ryzen 7000/8000 series with integrated graphics (Phoenix APUs) and may not apply to other hardware configurations.

Recommendation

Apply the workaround by setting the HSA_OVERRIDE_GFX_VERSION environment variable, as this has been shown to successfully enable iGPU detection and improve performance in Ollama.