starred/ollama-ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-17 15:53:27 +02:00
Code Issues Packages Projects Releases Wiki Activity

mlx: Remove peak memory from the API

Browse Source 
This is still in flux so it is better to just log it for now.
This commit is contained in:
Jesse Gross
2026-03-02 11:37:52 -08:00
parent c1e3ef4bcc
commit ad16bffc7d
5 changed files with 12 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
llm/server.go
View File

@@ -1518,7 +1518,6 @@ type CompletionResponse struct {
PromptEvalDuration time.Duration `json:"prompt_eval_duration"`
EvalCount int `json:"eval_count"`
EvalDuration time.Duration `json:"eval_duration"`
PeakMemory uint64 `json:"peak_memory,omitempty"`
// Logprobs contains log probability information if requested
Logprobs []Logprob `json:"logprobs,omitempty"`