Daniel Hiltgen 356c0b8e34 gemma4: add audio support with USM conformer encoder ...

Add audio encoding for Gemma 4 using the USM conformer architecture:
- Converter: audio tensor mapping, SSCP/conformer/embedder name replacements,
  softplus repacker for per_dim_scale, F32 enforcement for conv weights
- GGML backend: Conv1DDW and PadExt tensor ops
- Audio encoder: SSCP Conv2D, 12 conformer blocks (FFW + block-local
  attention with relative position embeddings + LightConv1d + FFW),
  output projection, audio-to-text embedding projector
- Audio preprocessing: WAV decode, mel spectrogram, FFT (pure Go)
- Model wiring: WAV detection, audio token handling, unified PostTokenize

Correctly transcribes "why is the sky blue" from test audio.

2026-04-01 15:24:17 -07:00

..

sentencepiece

chore(all): replace instances of interface with any (#10067)

2025-04-02 09:44:27 -07:00

testdata

convert: import support for command-r models from safetensors (#6063)

2025-01-15 16:31:22 -08:00

convert_bert.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_commandr.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_deepseek2.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_deepseekocr.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_gemma2_adapter.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_gemma2.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_gemma3.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_gemma3n.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_gemma4_test.go

gemma4: add audio support with USM conformer encoder

2026-04-01 15:24:17 -07:00

convert_gemma4.go

gemma4: add audio support with USM conformer encoder

2026-04-01 15:24:17 -07:00

convert_gemma.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_glm4moelite.go

Re-apply "model: add MLA absorption for glm4moelite" with fix (#13870)

2026-01-23 18:40:28 -08:00

convert_glmocr.go

Add GLM-OCR vision model support (#14024)

2026-02-02 15:39:18 -08:00

convert_gptoss.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_lfm2_test.go

model: improvements to LFM architectures (#14368)

2026-02-23 14:38:10 -08:00

convert_lfm2_vl_test.go

model: improvements to LFM architectures (#14368)

2026-02-23 14:38:10 -08:00

convert_lfm2_vl.go

model: improvements to LFM architectures (#14368)

2026-02-23 14:38:10 -08:00

convert_lfm2.go

model: improvements to LFM architectures (#14368)

2026-02-23 14:38:10 -08:00

convert_llama4.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_llama_adapter.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_llama.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_mistral_causal.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_mistral.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_mixtral.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_mllama.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_nemotron_h_test.go

models: add nemotronh architecture support (#14356)

2026-02-22 15:09:14 -08:00

convert_nemotron_h.go

models: add nemotronh architecture support (#14356)

2026-02-22 15:09:14 -08:00

convert_nomicbert.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_olmo.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_phi3.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_qwen2.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_qwen3.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_qwen3next_test.go

model: support for qwen3.5 architecture (#14378)

2026-02-24 20:08:05 -08:00

convert_qwen3next.go

model: support for qwen3.5 architecture (#14378)

2026-02-24 20:08:05 -08:00

convert_qwen3vl.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_qwen25vl.go

Add experimental MLX backend and engine with imagegen support (#13648)

2026-01-08 16:18:59 -08:00

convert_test.go

gemma4: add Gemma 4 GGML model support

2026-04-01 15:23:10 -07:00

convert.go

gemma4: add Gemma 4 GGML model support

2026-04-01 15:23:10 -07:00

json_compat_test.go

models: add nemotronh architecture support (#14356)

2026-02-22 15:09:14 -08:00

json_compat.go

models: add nemotronh architecture support (#14356)

2026-02-22 15:09:14 -08:00

reader_safetensors.go

gemma4: add Gemma 4 GGML model support

2026-04-01 15:23:10 -07:00

reader_test.go

convert: convert bf16 vision weights to fp16 (#12324)

2025-09-17 17:43:17 -07:00

reader_torch.go

llama4

2025-04-25 16:59:20 -07:00

reader.go

gemma4: add audio support with USM conformer encoder

2026-04-01 15:24:17 -07:00

sentencepiece_model.proto

all: fix typos in documentation, code, and comments (#7021)

2024-12-10 12:58:06 -08:00

tensor_test.go

fix tensor merge (#13053)

2025-11-13 15:32:34 -08:00

tensor.go

fix tensor merge (#13053)

2025-11-13 15:32:34 -08:00

tokenizer_spm.go

parsers/renderers: functiongemma (#13521)

2025-12-18 07:55:37 -08:00

tokenizer_test.go

model: support for qwen3.5 architecture (#14378)

2026-02-24 20:08:05 -08:00

tokenizer.go

model: support for qwen3.5 architecture (#14378)

2026-02-24 20:08:05 -08:00