Ryan GouldenandGitHub 26c9ce1288 server: Add cached_tokens info to oaicompat responses (#19361) ...

* tests : fix fetch_server_test_models.py

* server: to_json_oaicompat cached_tokens

Adds OpenAI and Anthropic compatible information about the
number of cached prompt tokens used in a response.

2026-03-19 19:09:33 +01:00

..

batched-bench

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

cli

common/parser: add proper reasoning tag prefill reading (#20424)

2026-03-19 16:58:21 +01:00

completion

common/parser: add --skip-chat-parsing to force a pure content parser. (#20289)

2026-03-17 16:16:43 +01:00

cvector-generator

chore : correct typos [no ci] (#20041)

2026-03-05 08:50:21 +01:00

export-lora

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

fit-params

llama-fit-params: keep explicit --ctx-size 0 (#19070)

2026-01-24 22:13:08 +01:00

gguf-split

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

imatrix

chore : correct typos [no ci] (#20041)

2026-03-05 08:50:21 +01:00

llama-bench

llama-bench: introduce -hf and -hff flags & use --mmap 1 by default (#20211)

2026-03-09 09:05:44 +08:00

mtmd

mtmd: add clip_graph::build_mm() (#20751)

2026-03-19 13:11:39 +01:00

parser

common/parser: add proper reasoning tag prefill reading (#20424)

2026-03-19 16:58:21 +01:00

perplexity

tools : enable kvu in perplexity for hellaswag, winogrande, multiple-choice (#19954)

2026-03-13 21:25:57 +01:00

quantize

llama-quant : fail early on missing imatrix, refactor type selection, code cleanup (#19770)

2026-03-10 08:16:05 +02:00

results

llama: end-to-end tests (#19802)

2026-03-08 12:30:21 +01:00

rpc

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

server

server: Add cached_tokens info to oaicompat responses (#19361)

2026-03-19 19:09:33 +01:00

tokenize

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

tts

Fix locale-dependent float printing in GGUF metadata (#17331)

2026-03-04 09:30:40 +01:00

CMakeLists.txt

llama: end-to-end tests (#19802)

2026-03-08 12:30:21 +01:00