Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,227 Commits 4 Branches 0 Tags
a00a35cef93e057eace8351a667d14d152a91ebc
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Pierrick Hymbert c0a8c6db37 server : health endpoint configurable failure on no slot (#5594) 2024-02-20 09:48:19 +02:00
Pierrick Hymbert c145f8a132 server : slots monitoring endpoint (#5550) 2024-02-18 19:39:57 +02:00
Pierrick Hymbert e75c6279d1 server : enhanced health endpoint (#5548) 
* server: enrich health endpoint with available slots, return 503 if not slots are available

* server: document new status no slot available in the README.md
 2024-02-18 18:31:28 +02:00
Pierrick Hymbert 36376abe05 server : --n-predict option document and cap to max value (#5549) 
* server: document --n-predict

* server: ensure client request cannot override n_predict if set

* server: fix print usage LF in new --n-predict option
 2024-02-18 18:30:09 +02:00