Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

server: support "reasoning_effort": "none" in OAI API (#26045)

Browse Source 
* support "reasoning_effort": "none" in OAI API

* handle reasoning.effort: "none" in OAI responses API

* clarify non-"none" values of reasoning_effort have no effect

* use json_value instead of body.at
This commit is contained in:
Nigel Bosch
2026-07-24 19:19:10 +02:00
committed by GitHub
parent 298219f985
commit 27209a598d
3 changed files with 19 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/server/server-common.cpp
+8
View File
@@ -1086,6 +1086,14 @@ json oaicompat_chat_params_parse(
throw std::invalid_argument("invalid type for \"enable_thinking\" (expected boolean, got string)");
}
// Parse also the OAI "reasoning_effort": "none" specific value
if (body.contains("reasoning_effort")) {
auto reasoning_effort = json_value(body, "reasoning_effort", std::string(""));
if (reasoning_effort == "none") {
inputs.enable_thinking = false;
} // other reasoning_effort values are model-specific and not yet handled
}
inputs.force_pure_content = opt.force_pure_content;
// Apply chat template to the list of messages