Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

server: support "reasoning_effort": "none" in OAI API (#26045)

Browse Source 
* support "reasoning_effort": "none" in OAI API

* handle reasoning.effort: "none" in OAI responses API

* clarify non-"none" values of reasoning_effort have no effect

* use json_value instead of body.at
This commit is contained in:
Nigel Bosch
2026-07-24 19:19:10 +02:00
committed by GitHub
parent 298219f985
commit 27209a598d
3 changed files with 19 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/server/server-chat.cpp
+9
View File
@@ -283,6 +283,15 @@ json server_chat_convert_responses_to_chatcmpl(const json & response_body) {
chatcmpl_body["max_tokens"] = response_body["max_output_tokens"];
}
if (response_body.contains("reasoning")) {
// Only "effort" is handled so far
const json & reasoning = response_body.at("reasoning");
if (reasoning.contains("effort")) {
chatcmpl_body["reasoning_effort"] = reasoning.at("effort");
}
chatcmpl_body.erase("reasoning");
}
return chatcmpl_body;
}