19 Commits

Author	SHA1	Message	Date
jmorganca	6dab2a9d3a	move sync script back in for now	2024-07-29 15:38:51 -07:00
jmorganca	028fda3582	cleanup stop code	2024-07-29 15:38:51 -07:00
jmorganca	a796b7aeaf	num predict	2024-07-29 15:38:51 -07:00
jmorganca	89cb4b8d6b	basic progress	2024-07-29 15:38:51 -07:00
jmorganca	0d365e8d34	add more runner params	2024-07-29 15:38:51 -07:00
jmorganca	72ff94efe0	truncate stop properly	2024-07-29 15:38:51 -07:00
jmorganca	240d4cf0aa	wip stop tokens	2024-07-29 15:38:51 -07:00
jmorganca	424627c347	embeddings	2024-07-29 15:38:51 -07:00
jmorganca	1a801fba2a	remove dependency on llm	2024-07-29 15:38:51 -07:00
jmorganca	727494ea54	grammar	2024-07-29 15:38:51 -07:00
jmorganca	b39fca7088	sampling	2024-07-29 15:38:51 -07:00
jmorganca	db55b1b89d	better example module, add port	2024-07-29 15:38:51 -07:00
jmorganca	1124e24aff	wip	2024-07-29 15:38:51 -07:00
jmorganca	df44d119a3	add llava to runner	2024-07-29 15:38:51 -07:00
jmorganca	878eb9a19f	add llava	2024-07-29 15:38:51 -07:00
jmorganca	4dd63c1fef	move runner package down	2024-07-29 15:38:51 -07:00
jmorganca	82214396b5	replace static build in llm	2024-07-29 15:38:51 -07:00
jmorganca	25fd8fd045	wip...	2024-07-29 15:35:09 -07:00
jmorganca	be2f37b5d4	rename server to runner	2024-07-29 15:35:09 -07:00