Lumpiasty/klaster
0
0
Fork 0
Code Issues Pull Requests 2 Packages Projects Releases Wiki Activity

enable MTP on MTP models
ci/woodpecker/push/flux-reconcile-source Pipeline was successful
Details
ci/woodpecker/cron/renovate Pipeline was successful
Details

Browse Source
This commit is contained in:
Lumpiasty
2026-05-18 20:18:18 +02:00
parent c3e5931c50
commit 55ac337a63
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
apps/llama/configs/config.yaml
+4
View File
@@ -190,6 +190,8 @@ models:
-hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:Q4_K_M -hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:Q4_K_M
${ctx_256k} ${ctx_256k}
${qwen35_think_args} ${qwen35_think_args}
--spec-type draft-mtp --spec-draft-n-max 1
--parallel 1
${common_args} ${common_args}
"unsloth/Qwen3.6-35B-A3B-MTP-GGUF-nothink:Q4_K_M": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF-nothink:Q4_K_M":
@@ -198,4 +200,6 @@ models:
-hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:Q4_K_M -hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:Q4_K_M
${ctx_256k} ${ctx_256k}
${qwen35_nothink_args} ${qwen35_nothink_args}
--spec-type draft-mtp --spec-draft-n-max 1
--parallel 1
${common_args} ${common_args}