starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-28 03:39:48 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
0d863c8cf419af373ca6a4e9496256b6ec2aeed7
ollama/x/mlxrunner/mlx/array.go
Jesse Gross 24e038d56a mlxrunner: add logprobs support 
Match the ollamarunner and OpenAI semantics: raw, full-vocab log-softmax
with the top-K ranked by probability. Skipped on the GPU when the request
doesn't ask for logprobs so decode doesn't pay for it otherwise.
2026-04-20 17:43:00 -07:00

5.8 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink