model : use exact GELU for ModernBERT encoders (#30108)

* model : use exact GELU for ModernBERT encoders

Assisted-by: Codex

* model : keep tanh GELU aliases on ggml_geglu

Assisted-by: Claude Opus 5.5

* model : map gelu_python to ggml_geglu_erf

Assisted-by: Claude Opus 5.5
This commit is contained in:
bosh authored and GitHub committed 2026-10-09 23:26:56 +08:00
1 parent 8b54361025
commit 6184e92c57
4 files changed
+22 -13

No files matched your search

+5
View File
@@ -1963,6 +1963,11 @@ ggml_tensor * llm_graph_context::build_ffn(
cur = ggml_geglu(ctx0, cur);
cb(cur, "ffn_geglu", il);
} break;
case LLM_FFN_GEGLU_ERF:
{
cur = ggml_geglu_erf(ctx0, cur);
cb(cur, "ffn_geglu_erf", il);
} break;
case LLM_FFN_REGLU:
{
cur = ggml_reglu(ctx0, cur);