add llava

This commit is contained in:
jmorganca
2024-05-19 16:30:11 -07:00
parent a9884ae136
commit a8f91d3cc1
22 changed files with 31207 additions and 11 deletions

9
llama/runner/README.md Normal file
View File

@@ -0,0 +1,9 @@
# `runner`
```
./runner -model <model binary>
```
```
curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/
```