rename server to runner

This commit is contained in:
jmorganca
2024-05-19 00:13:30 -04:00
committed by Daniel Hiltgen
parent 9e28405c54
commit be2f37b5d4
2 changed files with 3 additions and 3 deletions

9
llama/runner/README.md Normal file
View File

@@ -0,0 +1,9 @@
# `runner`
```
./runner -model <model binary>
```
```
curl POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/
```