starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-24 17:55:43 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
b00bd1dfd4e9c8cf012eb8a1d2e406565f00d13e
ollama/x/mlxrunner/cache_test.go
Jesse Gross 4f5999fd3f mlxrunner: schedule periodic snapshots during prefill 
Add periodic snapshots every 8k tokens and near the end of the prompt
so that long prompts can be partially restored and thinking/generation
can be retried without full reprocessing.
2026-03-26 13:32:11 -07:00

29 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink