starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-23 01:05:47 +02:00
Code Issues Packages Projects Releases Wiki Activity
5,087 Commits 388 Branches 507 Tags
8a257ec00a76d3dd90f0106fba1e56215588efae
Commit Graph

3 Commits

Author SHA1 Message Date
Patrick Devine
d18dcd7775 mlxrunner fixes (#14247) 
* load glm4_moe_lite from the mlxrunner

* fix loading diffusion models

* remove log lines

* fix --imagegen flag
 2026-02-13 22:30:42 -08:00
Patrick Devine
4a3741129d bug: fix loading non-mlx models when ollama is built with mlx support (#14211) 
This change fixes an issue where GGML based models (for either the Ollama runner or
the legacy llama.cpp runner) would try to load the mlx library. That would panic
and the model fails to start.
 2026-02-11 14:48:33 -08:00
Patrick Devine
44bdd9a2ef Add MLX runner with GLM4-MoE-Lite model support (#14185) 
This change adds a new MLX based runner which includes:

  * Method-based MLX bindings
  * Subprocess-based MLX runner (x/mlxrunner)
  * KV cache with tree management
  * A basic sampler

The GLM4-MoE-Lite model has been ported to use the new bindings.

---------

Co-authored-by: Michael Yang <git@mxy.ng>
 2026-02-10 14:57:57 -08:00