starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-26 02:36:09 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
415c8fcc3deee73e8a11822a962a87c7cb58d938
ollama/runner/ollamarunner
History
Jesse Gross a27462b708 ollamarunner: Temporarily disable worst case graph preallocation 
When we later have a large batch running purely on a CPU, this
results the error:
GGML_ASSERT(talloc->buffer_id >= 0)

Disabling this means that we will incrementally reallocate memory
as the graph grows.

Fixes #10410
2025-04-29 11:04:58 -07:00
..
cache_test.go
ollamarunner: Preallocate worst case graph at startup
2025-04-08 10:01:28 -07:00
cache.go
kvcache: Add check for values that fall out of sliding window cache
2025-04-02 11:55:48 -07:00
runner.go
ollamarunner: Temporarily disable worst case graph preallocation
2025-04-29 11:04:58 -07:00