starred/ollama-ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-17 15:53:27 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
764e199d6703d80da4d245381efa4a3a412813b2
ollama-ollama/kvcache
History
Michael Yang 764e199d67 kvcache: create cache ctx per layer 
each cache layer creates and maintains its own context instead of using
a large context for all layers
2025-03-07 14:08:21 -08:00
..
cache.go
attention: Remove unnecessary contiguous operations
2025-03-01 20:53:23 -08:00
causal_test.go
ml: Empty tensor constructor for tensors
2025-03-01 20:53:23 -08:00
causal.go
kvcache: create cache ctx per layer
2025-03-07 14:08:21 -08:00
encoder.go
kvcache: create cache ctx per layer
2025-03-07 14:08:21 -08:00
wrapper.go
attention: Remove unnecessary contiguous operations
2025-03-01 20:53:23 -08:00