llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818)
* init conversion * convert: ok * model loaded * add server code * improve conversion script * support shared prompt prefix * add docs, imorove UX a bit * add vision support * add openjev tiny model for testing * add dev docs * support lev & kev * clean up * fix lev noul * fix py lint * nits docs * clarify about not supporting date_facts
This commit is contained in:
1 parent
70849ee82c
commit
a4cb4c61fd
35 files changed
+2139
-15
No files matched your search
@@ -1495,6 +1495,17 @@ json server_task_result_rerank::to_json() {
|
||||
};
|
||||
}
|
||||
|
||||
//
|
||||
// server_task_result_decision
|
||||
//
|
||||
json server_task_result_decision::to_json() {
|
||||
return json {
|
||||
{"index", index},
|
||||
{"scores", scores},
|
||||
{"tokens_evaluated", n_tokens},
|
||||
};
|
||||
}
|
||||
|
||||
//
|
||||
// server_task_result_error
|
||||
//
|
||||
|
||||
Reference in new issue
Block a user