ollama - 💡(How to fix) Fix 显卡显存利用率不高

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
RAW_BUFFERClick to expand / collapse

我使用用 docker 部署 ollama,服务器有 4 张显卡,每张大小 23GB,但是实际使用每张占用 4GB 显存。以下是我的启动命令 docker run -d --name ollamagpu --restart unless-stopped --gpus all -p 11436:11434 -v /app/ollama_models:/root/.ollama -e CUDA_VISIBLE_DEVICES=0,1,2,3 -e OLLAMA_NUM_GPU=4 -e OLLAMA_NUM_CTX=8192 -e OLLAMA_TENSOR_SPLIT=1,1,1,1 ollama/ollama:latest;cuda版本是 12.0。

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

ollama - 💡(How to fix) Fix 显卡显存利用率不高