starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-26 02:36:09 +02:00
Code Issues Packages Projects Releases Wiki Activity
5,339 Commits 388 Branches 511 Tags
0d863c8cf419af373ca6a4e9496256b6ec2aeed7
Commit Graph

2 Commits

Author SHA1 Message Date
Daniel Hiltgen
5d920cc6bc Keep Gemma4 router projection in source precision (#15613) 2026-04-15 15:04:23 -07:00
Daniel Hiltgen
2cba7756c5 Gemma4 on MLX (#15244) 
* gemma4: implement Gemma 4 model for MLX (text-only runtime)

* gemma4: two MoE + SWA prefill perf fixes

Two performance optimizations in the gemma4 forward pass

1. Memoize the sliding-window prefill mask across layers.
2. Softmax only over the selected experts in Router.Forward.

* review comments
 2026-04-13 16:36:51 -07:00