model : use exact GELU for ModernBERT encoders (#30108)
* model : use exact GELU for ModernBERT encoders Assisted-by: Codex * model : keep tanh GELU aliases on ggml_geglu Assisted-by: Claude Opus 5.5 * model : map gelu_python to ggml_geglu_erf Assisted-by: Claude Opus 5.5
This commit is contained in:
4 files changed
+22
-13
No files matched your search
@@ -1963,6 +1963,11 @@ ggml_tensor * llm_graph_context::build_ffn(
|
||||
cur = ggml_geglu(ctx0, cur);
|
||||
cb(cur, "ffn_geglu", il);
|
||||
} break;
|
||||
case LLM_FFN_GEGLU_ERF:
|
||||
{
|
||||
cur = ggml_geglu_erf(ctx0, cur);
|
||||
cb(cur, "ffn_geglu_erf", il);
|
||||
} break;
|
||||
case LLM_FFN_REGLU:
|
||||
{
|
||||
cur = ggml_reglu(ctx0, cur);
|
||||
|
||||
Reference in new issue
Block a user