move runner package down

This commit is contained in:
jmorganca
2024-05-18 23:15:51 -07:00
committed by Daniel Hiltgen
parent 82214396b5
commit 4dd63c1fef
7 changed files with 96 additions and 47 deletions

9
runner/README.md Normal file
View File

@@ -0,0 +1,9 @@
# `runner`
```
./runner -model <model binary>
```
```
curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/
```