model: apply .scale tensors automatically + fix correctness (#32669)

* model: apply .scale tensors automatically

* rm build_moe_ffn "_s" overload

* use llama_prec_policy

* fix ci

* build_lora_mm_id: rm w_s
This commit is contained in:
Xuan-Son Nguyen authored and GitHub committed 2026-11-21 16:30:01 +01:00
1 parent e50c254a22
commit 19bc41dbb4
39 files changed
+164 -290

No files matched your search

+1 -1
View File
@@ -180,7 +180,7 @@ llama_model_muse_spark::graph::graph(const llm_graph_params & params)
(llama_expert_gating_func_type) hparams.expert_gating_func,
il,
router_logits,
nullptr, nullptr, nullptr, nullptr, nullptr,
nullptr, nullptr,
model.layers[il].ffn_post_exp_norm, hparams.f_post_norm_eps);
cb(moe_out, "ffn_moe_out", il);