starred/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-22 16:55:44 +02:00
Code Issues Packages Projects Releases Wiki Activity

move sync script back in for now

Browse Source
This commit is contained in:
jmorganca
2024-06-07 09:26:44 -07:00
committed by Daniel Hiltgen
parent 834aac8450
commit 6dab2a9d3a
3 changed files with 12 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
llama/runner/README.md
View File

@@ -1,11 +1,15 @@
# `runner`
A subprocess runner for loading a model and running inference via a small http web server.
A minimial runner for loading a model and running inference via a http web server.
```
./runner -model <model binary>
```
### Completion
```
curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/
curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/completion
```
### Embeddings