Mikhail Podvitskii
|
9a16f1dbe4
|
model : MTP support for Mellum2.1 (#30612)
* model : MTP support for Mellum
* model : inline rope construction in Mellum
|
2026-10-16 10:20:03 +02:00 |
|
 Mikhail PodvitskiiandSigbjørn Skjæret
|
a6b91d8c5e
|
model : Mellum - read MoE gating params from GGUF, unify RoPE (#30578)
* model : mellum - read MoE gating params from GGUF, unify RoPE
- read/write expert_weights_norm and expert_gating_func instead of hardcoded values (defaults unchanged)
- use per-layer rope params via get_rope_freq_base/scale
- check n_expert once, outside the layer loop
* Update conversion/mellum.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
[no release]
|
2026-10-15 16:24:47 +03:00 |
|
Xuan-Son Nguyen
|
fa88ae9368
|
convert: add @ModelBase.example (#27208)
* convert: add @ModelBase.example
* add docs
* add more variants
* BailingMoeV3ForCausalLM
* rm pocket-tts
|
2026-08-17 10:15:11 +02:00 |
|
 Mikhail PodvitskiiandSigbjørn Skjæret
|
4fb16eccce
|
model: add Mellum architecture (#23966)
* model: support for Mellum architecture
* model: improve mellum.py formatting
* model: improve mellum.py formatting once again
* deps: downgrade transformers to 4.57.6 (to fix CI)
* deps: remove huggingface_hub dependency
* deps: remove huggingface_hub from test requirements
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
|
2026-06-02 22:11:12 +03:00 |
|