Files
llama.cpp/tests/fusion/MTL.csv
T
usrlocalben bcb0152876 model: add Kimi-K3.1-Pro text model (#31779)
* model: add Kimi-K3.1-Pro text model

K3 with the full-attention MLA layers replaced by DSA: on this checkpoint 24
of the 93 layers carry a lightning indexer (32 heads x 128, top_k 2048, no
rope). The KDA (linear-attention) layers and the rest of the K3 skeleton -
cross-layer residuals, latent MoE, situ, MLA output gate, full-rank KDA gate -
are unchanged, so this reuses the K3 graph and converter and adds the indexer.

Indexer:
  - the selection is an additive mask over the whole cache, not a gather of
    the top-k rows, so it reuses the existing sparse flash attention path;
    off that path the mask stays correct but still costs a kq over the cache
  - the indexer key LayerNorm takes its eps from the model's rms_norm_eps,
    because dsa_config declares no eps of its own

Graph and cache:
  - new arch with four indexer tensors per DSA layer, and a hybrid memory
    that keeps a K-only MLA cache for those layers, recurrent state for the
    KDA layers, and the indexer key cache
  - the graph node budget shares the K3 entry

Conversion:
  - KimiK31Model(KimiK3Model), picked by KimiK31ForConditionalGeneration
  - dsa_config becomes attention.indexer.{head_count,key_length,top_k,types}
    plus the indexer LayerNorm eps; the layer list is 1-indexed like
    linear_attn_config's, and the converter asserts that it covers exactly
    the full-attention layers
  - the routed experts stay MXFP4 and are repacked as in K3, not dequantized
  - the vision tower and mm_projector are skipped: text only for now
  - the arch key follows the checkpoint's own model_type ("kimi_k31") and the
    loader registers KimiK31ForConditionalGeneration; the release name carries
    a -Pro suffix that nothing in the config or the tensor names uses

Quantisation: the indexer's q_b, k and proj are kept out of the quant
overrides, since the top-k selection is sensitive to their precision.

Verified on an 8-layer slice against the HF checkpoint: 38 tensors checked
exactly, the indexer metadata against the config, and the selection against
full attention - identical PPL at top_k beyond the context length, divergent
once top_k is forced below it. Arch test fixture and the full arch suite pass.

* converter: avoid clutter in the k3 base

* narrow comment to match model

* update metal fusion expectations

* restore

* sync with PR 31733 refactoring
2026-11-06 23:42:46 +01:00

25 KiB

1# test-fusion baseline for device MTL
2# arch ,moe ,mode ,label , count
3afmoe ,1 ,any ,MUL+ADD , 2
4afmoe ,1 ,any ,RMS_NORM+MUL , 10
5afmoe ,1 ,any ,RMS_NORM+MUL+ADD , 3
6afmoe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
7arcee ,0 ,any ,RMS_NORM+MUL , 5
8arctic ,0 ,any ,MUL+ADD , 4
9arctic ,0 ,any ,RMS_NORM+MUL , 7
10arctic ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
11baichuan ,0 ,any ,RMS_NORM+MUL , 5
12bailingmoe ,1 ,any ,ADD+ADD , 2
13bailingmoe ,1 ,any ,MUL+ADD , 4
14bailingmoe ,1 ,any ,RMS_NORM+MUL , 5
15bailingmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
16bailingmoe2 ,1 ,any ,ADD+ADD , 1
17bailingmoe2 ,1 ,any ,MUL+ADD , 2
18bailingmoe2 ,1 ,any ,RMS_NORM+MUL , 9
19bailingmoe2 ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
20bailingmoe3 ,1 ,any ,ADD+ADD , 1
21bailingmoe3 ,1 ,any ,GATED_DELTA_NET+CPY , 1
22bailingmoe3 ,1 ,any ,MUL+ADD , 2
23bailingmoe3 ,1 ,any ,RMS_NORM+MUL , 8
24bailingmoe3 ,1 ,any ,RMS_NORM+SCALE , 2
25bailingmoe3 ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
26beam ,0 ,any ,MUL+ADD , 6
27beam ,0 ,any ,RMS_NORM+MUL , 25
28bloom ,0 ,any ,NORM+MUL+ADD , 6
29chatglm ,0 ,any ,RMS_NORM+MUL , 5
30clover_moe ,1 ,any ,ADD+ADD , 2
31clover_moe ,1 ,any ,GATED_DELTA_NET+CPY , 1
32clover_moe ,1 ,any ,MUL+ADD , 4
33clover_moe ,1 ,any ,RMS_NORM+MUL , 8
34clover_moe ,1 ,any ,RMS_NORM+SCALE , 2
35clover_moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
36clover_moe ,1 ,any ,SSM_CONV+UNARY , 1
37codeshell ,0 ,any ,NORM+MUL+ADD , 5
38cogvlm ,0 ,any ,RMS_NORM+MUL , 5
39cohere2 ,0 ,any ,ADD+ADD , 2
40cohere2 ,0 ,any ,NORM+MUL , 3
41cohere2moe ,1 ,any ,ADD+ADD , 2
42cohere2moe ,1 ,any ,MUL+ADD , 2
43cohere2moe ,1 ,any ,RMS_NORM+MUL , 3
44command-r ,0 ,any ,NORM+MUL , 3
45dbrx ,0 ,any ,MUL+ADD , 4
46dbrx ,0 ,any ,NORM+MUL , 5
47dbrx ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
48deci ,0 ,any ,RMS_NORM+MUL , 5
49deepseek ,0 ,any ,ADD+ADD , 1
50deepseek ,0 ,any ,MUL+ADD , 2
51deepseek ,0 ,any ,RMS_NORM+MUL , 5
52deepseek ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 1
53deepseek2 ,0 ,any ,ADD+ADD , 1
54deepseek2 ,0 ,any ,MUL+ADD , 2
55deepseek2 ,0 ,any ,RMS_NORM+MUL , 9
56deepseek2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
57deepseek32 ,0 ,any ,ADD+ADD , 1
58deepseek32 ,0 ,any ,MUL+ADD , 2
59deepseek32 ,0 ,any ,NORM+MUL+ADD , 2
60deepseek32 ,0 ,any ,RMS_NORM+MUL , 9
61deepseek32 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
62deepseek4 ,0 ,any ,MUL+ADD , 8
63deepseek4 ,0 ,any ,RMS_NORM+MUL , 20
64deepseek4 ,0 ,any ,UNARY+SQRT+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 4
65deepseek41 ,0 ,any ,MUL+ADD , 12
66deepseek41 ,0 ,any ,RMS_NORM+MUL , 29
67deepseek41 ,0 ,any ,UNARY+SQRT+ADD+ARGSORT+GET_ROWS+SUM_ROWS+SCALE+DIV, 6
68dots1 ,0 ,any ,ADD+ADD , 1
69dots1 ,0 ,any ,MUL+ADD , 2
70dots1 ,0 ,any ,RMS_NORM+MUL , 9
71dots1 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
72dots3note ,0 ,any ,ADD+ADD , 1
73dots3note ,0 ,any ,MUL+ADD , 2
74dots3note ,0 ,any ,NORM+MUL+ADD , 1
75dots3note ,0 ,any ,RMS_NORM+MUL , 11
76dots3note ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
77dream ,0 ,any ,RMS_NORM+MUL , 5
78ernie4_5-moe ,1 ,any ,ADD+ADD , 1
79ernie4_5-moe ,1 ,any ,MUL+ADD , 2
80ernie4_5-moe ,1 ,any ,RMS_NORM+MUL , 5
81ernie4_5 ,0 ,any ,RMS_NORM+MUL , 5
82exaone ,0 ,any ,RMS_NORM+MUL , 5
83exaone-moe ,1 ,any ,ADD+ADD , 1
84exaone-moe ,1 ,any ,MUL+ADD , 2
85exaone-moe ,1 ,any ,RMS_NORM+MUL , 9
86exaone-moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
87exaone4 ,0 ,any ,RMS_NORM+MUL , 5
88exaone4 ,0 ,any ,RMS_NORM+MUL+ADD , 4
89falcon ,0 ,any ,ADD+ADD , 2
90falcon ,0 ,any ,NORM+MUL+ADD , 5
91falcon-h1 ,0 ,any ,ADD+ADD , 2
92falcon-h1 ,0 ,any ,RMS_NORM+MUL , 9
93flint ,0 ,any ,ADD+ADD , 1
94flint ,0 ,any ,MUL+ADD , 2
95flint ,0 ,any ,RMS_NORM+MUL , 9
96flint ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
97gemma ,0 ,any ,RMS_NORM+MUL , 5
98gemma2 ,0 ,any ,RMS_NORM+MUL , 5
99gemma2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
100gemma3 ,0 ,any ,RMS_NORM+MUL , 9
101gemma3 ,0 ,any ,RMS_NORM+MUL+ADD , 4
102gemma4 ,0 ,any ,RMS_NORM+MUL , 47
103gemma4 ,0 ,any ,RMS_NORM+MUL+ADD , 20
104glm-dsa ,0 ,any ,ADD+ADD , 1
105glm-dsa ,0 ,any ,MUL+ADD , 2
106glm-dsa ,0 ,any ,NORM+MUL+ADD , 2
107glm-dsa ,0 ,any ,RMS_NORM+MUL , 9
108glm-dsa ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
109glm4 ,0 ,any ,RMS_NORM+MUL , 5
110glm4 ,0 ,any ,RMS_NORM+MUL+ADD , 4
111glm4moe ,1 ,any ,ADD+ADD , 1
112glm4moe ,1 ,any ,MUL+ADD , 2
113glm4moe ,1 ,any ,RMS_NORM+MUL , 9
114glm4moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
115glm5-next ,0 ,any ,ADD+ADD+ADD , 1
116glm5-next ,0 ,any ,GATED_DELTA_NET+CPY , 1
117glm5-next ,0 ,any ,MUL+ADD , 2
118glm5-next ,0 ,any ,NORM+MUL+ADD , 1
119glm5-next ,0 ,any ,RMS_NORM+MUL , 8
120glm5-next ,0 ,any ,RMS_NORM+SCALE , 2
121glm5-next ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
122gpt-oss ,0 ,any ,MUL+ADD , 4
123gpt-oss ,0 ,any ,RMS_NORM+MUL , 5
124gpt2 ,0 ,any ,NORM+MUL+ADD , 5
125gptneox ,0 ,any ,NORM+MUL+ADD , 5
126granite ,0 ,any ,RMS_NORM+MUL , 5
127granite ,0 ,any ,MUL+ADD , 4
128granite ,0 ,any ,RMS_NORM+MUL , 5
129granite ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
130granite_swa ,0 ,any ,RMS_NORM+MUL , 5
131granitehybrid ,0 ,any ,RMS_NORM+MUL , 6
132granitemoe ,1 ,any ,RMS_NORM+MUL , 5
133granitemoe ,1 ,any ,MUL+ADD , 4
134granitemoe ,1 ,any ,RMS_NORM+MUL , 5
135granitemoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
136grok ,0 ,any ,MUL+ADD , 4
137grok ,0 ,any ,RMS_NORM+MUL , 5
138grok ,0 ,any ,RMS_NORM+MUL+ADD , 4
139grok ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
140grovemoe ,1 ,any ,ADD+ADD , 2
141grovemoe ,1 ,any ,MUL+ADD , 8
142grovemoe ,1 ,any ,RMS_NORM+MUL , 9
143hunyuan-dense ,0 ,any ,RMS_NORM+MUL , 9
144hunyuan-moe ,1 ,any ,ADD+ADD , 2
145hunyuan-moe ,1 ,any ,MUL+ADD , 4
146hunyuan-moe ,1 ,any ,RMS_NORM+MUL , 9
147hunyuan-moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
148hunyuan_vl ,0 ,any ,RMS_NORM+MUL , 9
149hy_v3 ,0 ,any ,ADD+ADD , 2
150hy_v3 ,0 ,any ,MUL+ADD , 4
151hy_v3 ,0 ,any ,RMS_NORM+MUL , 9
152hy_v3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 2
153hy_v4 ,0 ,any ,MUL+ADD , 2
154hy_v4 ,0 ,any ,NORM+MUL+ADD , 1
155hy_v4 ,0 ,any ,RMS_NORM+MUL , 9
156hy_v4 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
157internlm2 ,0 ,any ,RMS_NORM+MUL , 5
158jais ,0 ,any ,NORM+MUL+ADD , 5
159jais2 ,0 ,any ,NORM+MUL+ADD , 5
160jamba ,0 ,any ,RMS_NORM+MUL , 8
161k2-horizon ,0 ,any ,RMS_NORM+MUL , 4
162k2-horizon ,0 ,any ,ADD+ADD , 1
163k2-horizon ,0 ,any ,MUL+ADD , 2
164k2-horizon ,0 ,any ,RMS_NORM+MUL , 4
165k2-horizon ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
166kimi-k3 ,0 ,any ,GATED_DELTA_NET+CPY , 1
167kimi-k3 ,0 ,any ,MUL+ADD , 2
168kimi-k3 ,0 ,any ,RMS_NORM+MUL , 17
169kimi-k3 ,0 ,any ,RMS_NORM+SCALE , 2
170kimi-k3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
171kimi-k31 ,0 ,any ,GATED_DELTA_NET+CPY , 1
172kimi-k31 ,0 ,any ,MUL+ADD , 2
173kimi-k31 ,0 ,any ,NORM+MUL+ADD , 1
174kimi-k31 ,0 ,any ,RMS_NORM+MUL , 17
175kimi-k31 ,0 ,any ,RMS_NORM+SCALE , 2
176kimi-k31 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
177kimi-linear ,0 ,any ,ADD+ADD , 1
178kimi-linear ,0 ,any ,GATED_DELTA_NET+CPY , 1
179kimi-linear ,0 ,any ,MUL+ADD , 2
180kimi-linear ,0 ,any ,RMS_NORM+MUL , 7
181kimi-linear ,0 ,any ,RMS_NORM+SCALE , 2
182kimi-linear ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
183kolibri1 ,0 ,any ,MUL+ADD , 4
184kolibri1 ,0 ,any ,RMS_NORM+MUL , 10
185kolibri1 ,0 ,any ,RMS_NORM+MUL+ADD , 3
186laguna ,0 ,any ,ADD+ADD , 1
187laguna ,0 ,any ,MUL+ADD , 2
188laguna ,0 ,any ,RMS_NORM+MUL , 9
189laguna ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
190lfm2 ,0 ,any ,RMS_NORM+MUL , 7
191lfm2moe ,1 ,any ,MUL+ADD , 2
192lfm2moe ,1 ,any ,RMS_NORM+MUL , 7
193lfm2moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
194lfm3 ,0 ,any ,RMS_NORM+MUL , 17
195llada ,0 ,any ,RMS_NORM+MUL , 5
196llada-moe ,1 ,any ,MUL+ADD , 4
197llada-moe ,1 ,any ,RMS_NORM+MUL , 9
198llada-moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
199llama ,0 ,any ,RMS_NORM+MUL , 5
200llama ,0 ,any ,MUL+ADD , 4
201llama ,0 ,any ,RMS_NORM+MUL , 5
202llama ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
203llama4 ,0 ,any ,ADD+ADD , 2
204llama4 ,0 ,any ,RMS_NORM+MUL , 9
205maincoder ,0 ,any ,RMS_NORM+MUL , 9
206maion-coder ,0 ,any ,MUL+ADD , 4
207maion-coder ,0 ,any ,RMS_NORM+MUL , 17
208maion-coder ,0 ,any ,RMS_NORM+MUL+ADD , 8
209maion-coder ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
210mamba ,0 ,any ,RMS_NORM+MUL , 3
211mamba2 ,0 ,any ,RMS_NORM+MUL , 5
212maple ,0 ,any ,MUL+ADD , 4
213maple ,0 ,any ,RMS_NORM+MUL , 9
214maple ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
215mellum ,0 ,any ,MUL+ADD , 4
216mellum ,0 ,any ,RMS_NORM+MUL , 9
217mellum ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
218metis16 ,0 ,any ,MUL+ADD , 8
219metis16 ,0 ,any ,RMS_NORM+MUL , 11
220mimo2 ,0 ,any ,MUL+ADD , 4
221mimo2 ,0 ,any ,RMS_NORM+MUL , 5
222mimo2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
223minicpm ,0 ,any ,RMS_NORM+MUL , 5
224minicpm ,0 ,any ,MUL+ADD , 4
225minicpm ,0 ,any ,RMS_NORM+MUL , 5
226minicpm ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
227minicpm3 ,0 ,any ,RMS_NORM+MUL , 9
228minimax-01 ,0 ,any ,MUL+ADD , 4
229minimax-01 ,0 ,any ,RMS_NORM+MUL , 6
230minimax-01 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
231minimax-m2 ,0 ,any ,MUL+ADD , 4
232minimax-m2 ,0 ,any ,RMS_NORM+MUL , 9
233minimax-m2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
234minimax-m3 ,0 ,any ,ADD+ADD , 1
235minimax-m3 ,0 ,any ,MUL+ADD , 2
236minimax-m3 ,0 ,any ,RMS_NORM+MUL , 11
237minimax-m3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
238mistral-large4 ,0 ,any ,ADD+ADD , 3
239mistral-large4 ,0 ,any ,MUL+ADD , 6
240mistral-large4 ,0 ,any ,NORM+MUL+ADD , 6
241mistral-large4 ,0 ,any ,RMS_NORM+MUL , 12
242mistral3 ,0 ,any ,RMS_NORM+MUL , 5
243mistral3 ,0 ,any ,MUL+ADD , 4
244mistral3 ,0 ,any ,RMS_NORM+MUL , 5
245mistral3 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
246mistral4 ,0 ,any ,ADD+ADD , 1
247mistral4 ,0 ,any ,MUL+ADD , 2
248mistral4 ,0 ,any ,RMS_NORM+MUL , 9
249mistral4 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
250mpt ,0 ,any ,NORM+MUL+ADD , 5
251muse-glimmer ,0 ,any ,RMS_NORM+MUL , 10
252muse-glimmer ,0 ,any ,RMS_NORM+MUL+ADD , 3
253muse-spark ,0 ,prefill ,MUL+ADD , 2
254muse-spark ,0 ,decode ,MUL+ADD , 4
255muse-spark ,0 ,any ,RMS_NORM+MUL , 14
256muse-spark ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
257nanbeige ,0 ,any ,RMS_NORM+MUL , 5
258nemotron ,0 ,any ,NORM+MUL+ADD , 5
259nemotron_h ,0 ,any ,RMS_NORM+MUL , 5
260nemotron_h_moe ,1 ,any ,RMS_NORM+MUL , 5
261olmo2 ,0 ,any ,RMS_NORM+MUL , 5
262olmo2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
263olmoe ,1 ,any ,MUL+ADD , 4
264olmoe ,1 ,any ,RMS_NORM+MUL , 9
265olmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
266openelm ,0 ,any ,RMS_NORM+MUL , 9
267orion ,0 ,any ,NORM+MUL+ADD , 5
268paddleocr ,0 ,any ,RMS_NORM+MUL , 5
269pangu-embedded ,0 ,any ,RMS_NORM+MUL , 5
270phi2 ,0 ,any ,ADD+ADD , 2
271phi2 ,0 ,any ,NORM+MUL+ADD , 3
272phi3 ,0 ,any ,RMS_NORM+MUL , 5
273phimoe ,1 ,any ,MUL+ADD , 4
274phimoe ,1 ,any ,RMS_NORM+MUL+ADD , 5
275phimoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
276plamo ,0 ,any ,ADD+ADD , 2
277plamo ,0 ,any ,RMS_NORM+MUL , 3
278plamo2 ,0 ,any ,RMS_NORM+MUL , 10
279plamo2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
280plamo2 ,0 ,any ,SSM_CONV+UNARY , 1
281plamo3 ,0 ,any ,RMS_NORM+MUL , 9
282plamo3 ,0 ,any ,RMS_NORM+MUL+ADD , 4
283pockettts ,0 ,any ,NORM+MUL+ADD , 5
284qwen ,0 ,any ,RMS_NORM+MUL , 5
285qwen2 ,0 ,any ,RMS_NORM+MUL , 5
286qwen2moe ,1 ,any ,ADD+ADD , 2
287qwen2moe ,1 ,any ,MUL+ADD , 4
288qwen2moe ,1 ,any ,RMS_NORM+MUL , 5
289qwen2moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
290qwen2vl ,0 ,any ,RMS_NORM+MUL , 5
291qwen3 ,0 ,any ,RMS_NORM+MUL , 9
292qwen35 ,0 ,any ,GATED_DELTA_NET+CPY , 1
293qwen35 ,0 ,any ,RMS_NORM+MUL , 8
294qwen35 ,0 ,any ,RMS_NORM+SCALE , 2
295qwen35 ,0 ,any ,SSM_CONV+UNARY , 1
296qwen35moe ,1 ,any ,ADD+ADD , 2
297qwen35moe ,1 ,any ,GATED_DELTA_NET+CPY , 1
298qwen35moe ,1 ,any ,MUL+ADD , 4
299qwen35moe ,1 ,any ,RMS_NORM+MUL , 8
300qwen35moe ,1 ,any ,RMS_NORM+SCALE , 2
301qwen35moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
302qwen35moe ,1 ,any ,SSM_CONV+UNARY , 1
303qwen3moe ,1 ,any ,MUL+ADD , 4
304qwen3moe ,1 ,any ,RMS_NORM+MUL , 9
305qwen3moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
306qwen3next ,0 ,any ,ADD+ADD , 2
307qwen3next ,0 ,any ,GATED_DELTA_NET+CPY , 1
308qwen3next ,0 ,any ,MUL+ADD , 4
309qwen3next ,0 ,any ,RMS_NORM+MUL , 8
310qwen3next ,0 ,any ,RMS_NORM+SCALE , 2
311qwen3next ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
312qwen3next ,0 ,any ,SSM_CONV+UNARY , 1
313qwen3tts ,0 ,any ,RMS_NORM+MUL , 9
314qwen3vl ,0 ,any ,RMS_NORM+MUL , 9
315qwen3vlmoe ,1 ,any ,MUL+ADD , 4
316qwen3vlmoe ,1 ,any ,RMS_NORM+MUL , 9
317qwen3vlmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
318qwen4exp ,0 ,any ,ADD+ADD+ADD , 2
319qwen4exp ,0 ,any ,GATED_DELTA_NET+CPY , 1
320qwen4exp ,0 ,any ,MUL+ADD , 4
321qwen4exp ,0 ,any ,RMS_NORM+MUL , 13
322qwen4exp ,0 ,any ,RMS_NORM+SCALE , 2
323qwen4exp ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
324qwen4exp ,0 ,any ,SSM_CONV+UNARY , 1
325refact ,0 ,any ,RMS_NORM+MUL , 5
326refact ,0 ,any ,RMS_NORM+MUL , 5
327ricursive ,0 ,any ,RMS_NORM+MUL , 9
328ricursive ,0 ,any ,RMS_NORM+MUL+ADD , 4
329rnd1 ,0 ,any ,MUL+ADD , 4
330rnd1 ,0 ,any ,RMS_NORM+MUL , 9
331rnd1 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
332seed_oss ,0 ,any ,RMS_NORM+MUL , 5
333smallthinker ,0 ,any ,MUL+ADD , 4
334smallthinker ,0 ,any ,RMS_NORM+MUL , 5
335smollm3 ,0 ,any ,RMS_NORM+MUL , 5
336spark2_5 ,0 ,any ,RMS_NORM+MUL , 5
337stablelm ,0 ,any ,NORM+MUL , 4
338stablelm ,0 ,any ,NORM+MUL+ADD , 5
339starcoder ,0 ,any ,NORM+MUL+ADD , 5
340starcoder2 ,0 ,any ,NORM+MUL+ADD , 5
341talkie ,0 ,any ,ADD+ADD , 2
342xing4_0 ,0 ,any ,ADD+ADD+ADD , 1
343xing4_0 ,0 ,any ,MUL+ADD , 2
344xing4_0 ,0 ,any ,RMS_NORM+MUL , 9
345xing4_0 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
346xverse ,0 ,any ,RMS_NORM+MUL , 5