starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-25 18:25:42 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
e5bcc51ae199116a635d74be3a510c5aeeb2894a
ollama/model
History
Jesse Gross bd6a7d5e64 ollamarunner: Pass runner performance parameters to backends 
Currently the following parameters are in the runner but not used:
 - numGPULayers
 - mainGPU
 - threads
 - tensorSplit

This passes them through to the backend, which is where they would
actually get used. However, the GGML backend does not yet do anything
with them.
2025-02-20 13:27:57 -08:00
..
imageproc
imageproc mllama refactor (#7537)
2024-12-14 19:50:15 -08:00
models
Runner for Ollama engine
2025-02-13 17:09:26 -08:00
testdata
next ollama runner (#7913)
2025-02-13 16:31:21 -08:00
model_test.go
Runner for Ollama engine
2025-02-13 17:09:26 -08:00
model.go
ollamarunner: Pass runner performance parameters to backends
2025-02-20 13:27:57 -08:00
process_text_test.go
next ollama runner (#7913)
2025-02-13 16:31:21 -08:00
process_text.go
vocab: Use int32 for special tokens
2025-02-13 17:09:26 -08:00