Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

mtp: support for gemma-4 E2B and E4B assistants (#24282)

Browse Source 
* models: update converter to support smaller assistants

* models: add masked_embd tensors to gemma4-assist arch

* gemma-4: remove temp debug for conversion

* gemma-4-mtp: filter out masked_embedding tensors during conversion
This commit is contained in:
Max Krasnyansky
2026-06-08 13:48:52 -07:00
committed by GitHub
parent 42a0afd594
commit 7d2b45b4f7
6 changed files with 34 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/llama-arch.h
+3
View File
@@ -566,8 +566,11 @@ enum llm_tensor {
LLM_TENSOR_NEXTN_HNORM,
LLM_TENSOR_NEXTN_SHARED_HEAD_HEAD,
LLM_TENSOR_NEXTN_SHARED_HEAD_NORM,
LLM_TENSOR_MASKED_EMBD_CENTROIDS,
LLM_TENSOR_MASKED_EMBD_ORDERING,
};
enum llm_tensor_layer {
LLM_TENSOR_LAYER_INPUT,
LLM_TENSOR_LAYER_REPEATING,