Commit Graph

7 Commits

Author SHA1 Message Date
yeongbba
4b74cee096 making amdgpu work on arm achitecutre with vulkan 2025-01-19 01:30:34 +09:00
pufferffish
5f1a301981 Merge branch 'main' into vulkan
# Conflicts:
#	gpu/gpu_linux.go
2024-09-23 18:33:55 +08:00
Daniel Hiltgen
74d45f0102 Refactor linux packaging
This adjusts linux to follow a similar model to windows with a discrete archive
(zip/tgz) to cary the primary executable, and dependent libraries. Runners are
still carried as payloads inside the main binary

Darwin retain the payload model where the go binary is fully self contained.
2024-08-19 09:38:53 -07:00
Michael Yang
b732beba6a lint 2024-08-01 17:06:06 -07:00
Jeffrey Morgan
c4cf8ad559 llm: avoid loading model if system memory is too small (#5637)
* llm: avoid loading model if system memory is too small

* update log

* Instrument swap free space

On linux and windows, expose how much swap space is available
so we can take that into consideration when scheduling models

* use `systemSwapFreeMemory` in check

---------

Co-authored-by: Daniel Hiltgen <daniel@ollama.com>
2024-07-11 16:42:57 -07:00
pufferffish
18f3f960b0 update gpu.go 2024-06-15 12:05:01 +01:00
Daniel Hiltgen
6f351bf586 review comments and coverage 2024-06-14 14:55:50 -07:00