llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818)

* init conversion

* convert: ok

* model loaded

* add server code

* improve conversion script

* support shared prompt prefix

* add docs, imorove UX a bit

* add vision support

* add openjev tiny model for testing

* add dev docs

* support lev & kev

* clean up

* fix lev noul

* fix py lint

* nits docs

* clarify about not supporting date_facts
This commit is contained in:
Xuan-Son Nguyen authored and GitHub committed 2026-10-02 11:56:04 +02:00
1 parent 70849ee82c
commit a4cb4c61fd
35 files changed
+2139 -15

No files matched your search

+11
View File
@@ -1495,6 +1495,17 @@ json server_task_result_rerank::to_json() {
};
}
//
// server_task_result_decision
//
json server_task_result_decision::to_json() {
return json {
{"index", index},
{"scores", scores},
{"tokens_evaluated", n_tokens},
};
}
//
// server_task_result_error
//