starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-21 00:05:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,889 Commits 387 Branches 504 Tags
23a7ea593bb6a3f8df5dcea35b743d2d10b10d0e
Commit Graph

4 Commits

Author SHA1 Message Date
Daniel Hiltgen
987c16b2f7 Report more information about GPUs in verbose mode 
This adds additional calls to both CUDA and ROCm management libraries to
discover additional attributes about the GPU(s) detected in the system, and
wires up runtime verbosity selection.  When users hit problems with GPUs we can
ask them to run with `OLLAMA_DEBUG=1 ollama serve` and share the results.
 2024-01-23 11:37:02 -08:00
Jeffrey Morgan
c336693f07 calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
Daniel Hiltgen
a2ad952440 Fix windows system memory lookup 
This refines the gpu package error handling and fixes a bug with the
system memory lookup on windows.
 2024-01-03 08:50:01 -08:00
Daniel Hiltgen
35934b2e05 Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00