Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

server: add dedup-cache-models preset option (#27346)

Browse Source
This commit is contained in:
Xuan-Son Nguyen
2026-08-19 11:04:26 +02:00
committed by GitHub
parent 98d1e92c21
commit ee4c505a4f
8 changed files with 132 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/server/README.md
+1
View File
@@ -1759,6 +1759,7 @@ The precedence rule for preset options is as follows:
We also offer additional options that are exclusive to presets (these aren't treated as command-line arguments):
- `load-on-startup` (boolean): Controls whether the model loads automatically when the server starts
- `stop-timeout` (int, seconds): After requested unload, wait for this many seconds before forcing termination (default: 10)
- `dedup-cache-models` (boolean): When the preset uses `hf-repo` pointing to a model that is already downloaded, hide the corresponding cached model entry from `GET /models` (the preset entry remains visible). Set it in the `[*]` section to apply to all presets.
### Routing requests