starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-24 09:46:01 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
b7b2aa5d4e5c4f8fbe2044714ca0fb5de6d6f196
ollama/x/mlxrunner/batch
History
Jesse Gross 987f74c8a5 mlxrunner: introduce ForwardBatch for model forward pass 
Replace the raw *mlx.Array token input with a ForwardBatch struct
that carries InputIDs alongside sequence metadata (SeqIDs, SeqLens).
InputIDs remain [1, N] shaped — all model code is unchanged beyond
the signature.
2026-04-03 19:50:41 -07:00
..
batch.go
mlxrunner: introduce ForwardBatch for model forward pass
2026-04-03 19:50:41 -07:00