Files
llama.cpp/tests/fusion/MTL.csv
T
Georgi Gerganov ea40a3a1e1 metal : fuse DeepSeek-V4/V4.1 and GLM MoE routing (#31615)
* metal : support scale-bias routing norm in the TOPK_MOE fusion

The DeepSeek-V4.1 graph normalizes the routing weights with a scale+bias
(sum + 1e-20) instead of the lower clamp used by the other models. Add
norm_bias/norm_scale_bias fusion chains that accept a SCALE node with a
unit scale factor at the clamp position, pass an additive bias in the
kernel args, and apply it as max(wt_sum, clamp) + bias so both variants
share one kernel. Cover the new chains in test-backend-ops.

Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (Mac Studio, M5 Ultra, 256GB)

* metal : fuse sqrt(softplus) MoE routing with a selection bias

Add TOPK_MOE chains anchored at the softplus node (UNARY+SQRT+ADD+
ARGSORT+GET_ROWS plus optional norm/scale) so the DeepSeek-V4/V4.1
routing fuses on Metal. The kernel scores with sqrt(softplus) and ranks
selection-biased keys while the gathered weights and the norm stay
unbiased, matching the reference graph. Dispatch hooks at the softplus
node, cover the norm-bias combination in test-backend-ops and record the
new deepseek4/deepseek41 fusion counters.

Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (Mac Studio, M5 Ultra, 256GB)

* metal : fuse sigmoid MoE routing with a selection bias

The sigmoid-gated MoE archs (GLM, DeepSeek-V2/V3.2, ...) rank
sigmoid(logits) + exp_probs_b with an optional weights-norm, but only
the softmax and sqrt(softplus) routing chains were fusable.

- add 6 sigmoid-anchored TOPK_MOE chains: sigmoid + ADD + ARGSORT +
  GET_ROWS with optional SCALE and SUM_ROWS + CLAMP/SCALE + DIV norm
  tail; the selection-bias ADD is required, same as the sqrt(softplus)
  chains
- generalize the gating function constant from a sqrt(softplus) bool
  to an int (0 = softmax, 1 = sqrt(softplus), 2 = sigmoid); sigmoid
  scores are 1 / (1 + exp(-logits)), matching the CPU, Metal unary and
  CUDA kernels
- anchor the unary dispatch hook at sigmoid nodes too
- test-backend-ops: 4 sigmoid routing cases with and without a
  weights scale
- re-record tests/fusion/MTL.csv: the sigmoid archs (glm5-next,
  deepseek2/32, kimi, minimax, ...) now fuse their routing, and
  muse-spark prefill drops one MOE_REDUCE fire because the reordered
  graph allocates the routing weights inside the reduce output range,
  which the dst/input overlap check correctly declines

Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (Mac Studio, M5 Ultra, 256GB)

* cont : remove low-signal comments

* ocd : valign ggml_metal_fusions
2026-11-05 13:52:56 +02:00

24 KiB

1# test-fusion baseline for device MTL
2# arch ,moe ,mode ,label , count
3afmoe ,1 ,any ,MUL+ADD , 2
4afmoe ,1 ,any ,RMS_NORM+MUL , 10
5afmoe ,1 ,any ,RMS_NORM+MUL+ADD , 3
6afmoe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
7arcee ,0 ,any ,RMS_NORM+MUL , 5
8arctic ,0 ,any ,MUL+ADD , 4
9arctic ,0 ,any ,RMS_NORM+MUL , 7
10arctic ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
11baichuan ,0 ,any ,RMS_NORM+MUL , 5
12bailingmoe ,1 ,any ,ADD+ADD , 2
13bailingmoe ,1 ,any ,MUL+ADD , 4
14bailingmoe ,1 ,any ,RMS_NORM+MUL , 5
15bailingmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
16bailingmoe2 ,1 ,any ,ADD+ADD , 1
17bailingmoe2 ,1 ,any ,MUL+ADD , 2
18bailingmoe2 ,1 ,any ,RMS_NORM+MUL , 9
19bailingmoe2 ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
20bailingmoe3 ,1 ,any ,ADD+ADD , 1
21bailingmoe3 ,1 ,any ,GATED_DELTA_NET+CPY , 1
22bailingmoe3 ,1 ,any ,MUL+ADD , 2
23bailingmoe3 ,1 ,any ,RMS_NORM+MUL , 8
24bailingmoe3 ,1 ,any ,RMS_NORM+SCALE , 2
25bailingmoe3 ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
26beam ,0 ,any ,MUL+ADD , 6
27beam ,0 ,any ,RMS_NORM+MUL , 25
28bloom ,0 ,any ,NORM+MUL+ADD , 6
29chatglm ,0 ,any ,RMS_NORM+MUL , 5
30clover_moe ,1 ,any ,ADD+ADD , 2
31clover_moe ,1 ,any ,GATED_DELTA_NET+CPY , 1
32clover_moe ,1 ,any ,MUL+ADD , 4
33clover_moe ,1 ,any ,RMS_NORM+MUL , 8
34clover_moe ,1 ,any ,RMS_NORM+SCALE , 2
35clover_moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
36clover_moe ,1 ,any ,SSM_CONV+UNARY , 1
37codeshell ,0 ,any ,NORM+MUL+ADD , 5
38cogvlm ,0 ,any ,RMS_NORM+MUL , 5
39cohere2 ,0 ,any ,ADD+ADD , 2
40cohere2 ,0 ,any ,NORM+MUL , 3
41cohere2moe ,1 ,any ,ADD+ADD , 2
42cohere2moe ,1 ,any ,MUL+ADD , 2
43cohere2moe ,1 ,any ,RMS_NORM+MUL , 3
44command-r ,0 ,any ,NORM+MUL , 3
45dbrx ,0 ,any ,MUL+ADD , 4
46dbrx ,0 ,any ,NORM+MUL , 5
47dbrx ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
48deci ,0 ,any ,RMS_NORM+MUL , 5
49deepseek ,0 ,any ,ADD+ADD , 1
50deepseek ,0 ,any ,MUL+ADD , 2
51deepseek ,0 ,any ,RMS_NORM+MUL , 5
52deepseek ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 1
53deepseek2 ,0 ,any ,ADD+ADD , 1
54deepseek2 ,0 ,any ,MUL+ADD , 2
55deepseek2 ,0 ,any ,RMS_NORM+MUL , 9
56deepseek2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
57deepseek32 ,0 ,any ,ADD+ADD , 1
58deepseek32 ,0 ,any ,MUL+ADD , 2
59deepseek32 ,0 ,any ,NORM+MUL+ADD , 2
60deepseek32 ,0 ,any ,RMS_NORM+MUL , 9
61deepseek32 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
62deepseek4 ,0 ,any ,MUL+ADD , 8
63deepseek4 ,0 ,any ,RMS_NORM+MUL , 20
64deepseek4 ,0 ,any ,UNARY+SQRT+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 4
65deepseek41 ,0 ,any ,MUL+ADD , 12
66deepseek41 ,0 ,any ,RMS_NORM+MUL , 29
67deepseek41 ,0 ,any ,UNARY+SQRT+ADD+ARGSORT+GET_ROWS+SUM_ROWS+SCALE+DIV, 6
68dots1 ,0 ,any ,ADD+ADD , 1
69dots1 ,0 ,any ,MUL+ADD , 2
70dots1 ,0 ,any ,RMS_NORM+MUL , 9
71dots1 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
72dots3note ,0 ,any ,ADD+ADD , 1
73dots3note ,0 ,any ,MUL+ADD , 2
74dots3note ,0 ,any ,NORM+MUL+ADD , 1
75dots3note ,0 ,any ,RMS_NORM+MUL , 11
76dots3note ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
77dream ,0 ,any ,RMS_NORM+MUL , 5
78ernie4_5-moe ,1 ,any ,ADD+ADD , 1
79ernie4_5-moe ,1 ,any ,MUL+ADD , 2
80ernie4_5-moe ,1 ,any ,RMS_NORM+MUL , 5
81ernie4_5 ,0 ,any ,RMS_NORM+MUL , 5
82exaone ,0 ,any ,RMS_NORM+MUL , 5
83exaone-moe ,1 ,any ,ADD+ADD , 1
84exaone-moe ,1 ,any ,MUL+ADD , 2
85exaone-moe ,1 ,any ,RMS_NORM+MUL , 9
86exaone-moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
87exaone4 ,0 ,any ,RMS_NORM+MUL , 5
88exaone4 ,0 ,any ,RMS_NORM+MUL+ADD , 4
89falcon ,0 ,any ,ADD+ADD , 2
90falcon ,0 ,any ,NORM+MUL+ADD , 5
91falcon-h1 ,0 ,any ,ADD+ADD , 2
92falcon-h1 ,0 ,any ,RMS_NORM+MUL , 9
93flint ,0 ,any ,ADD+ADD , 1
94flint ,0 ,any ,MUL+ADD , 2
95flint ,0 ,any ,RMS_NORM+MUL , 9
96flint ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
97gemma ,0 ,any ,RMS_NORM+MUL , 5
98gemma2 ,0 ,any ,RMS_NORM+MUL , 5
99gemma2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
100gemma3 ,0 ,any ,RMS_NORM+MUL , 9
101gemma3 ,0 ,any ,RMS_NORM+MUL+ADD , 4
102gemma4 ,0 ,any ,RMS_NORM+MUL , 47
103gemma4 ,0 ,any ,RMS_NORM+MUL+ADD , 20
104glm-dsa ,0 ,any ,ADD+ADD , 1
105glm-dsa ,0 ,any ,MUL+ADD , 2
106glm-dsa ,0 ,any ,NORM+MUL+ADD , 2
107glm-dsa ,0 ,any ,RMS_NORM+MUL , 9
108glm-dsa ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
109glm4 ,0 ,any ,RMS_NORM+MUL , 5
110glm4 ,0 ,any ,RMS_NORM+MUL+ADD , 4
111glm4moe ,1 ,any ,ADD+ADD , 1
112glm4moe ,1 ,any ,MUL+ADD , 2
113glm4moe ,1 ,any ,RMS_NORM+MUL , 9
114glm4moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
115glm5-next ,0 ,any ,ADD+ADD+ADD , 1
116glm5-next ,0 ,any ,GATED_DELTA_NET+CPY , 1
117glm5-next ,0 ,any ,MUL+ADD , 2
118glm5-next ,0 ,any ,NORM+MUL+ADD , 1
119glm5-next ,0 ,any ,RMS_NORM+MUL , 8
120glm5-next ,0 ,any ,RMS_NORM+SCALE , 2
121glm5-next ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
122gpt-oss ,0 ,any ,MUL+ADD , 4
123gpt-oss ,0 ,any ,RMS_NORM+MUL , 5
124gpt2 ,0 ,any ,NORM+MUL+ADD , 5
125gptneox ,0 ,any ,NORM+MUL+ADD , 5
126granite ,0 ,any ,RMS_NORM+MUL , 5
127granite ,0 ,any ,MUL+ADD , 4
128granite ,0 ,any ,RMS_NORM+MUL , 5
129granite ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
130granite_swa ,0 ,any ,RMS_NORM+MUL , 5
131granitehybrid ,0 ,any ,RMS_NORM+MUL , 6
132granitemoe ,1 ,any ,RMS_NORM+MUL , 5
133granitemoe ,1 ,any ,MUL+ADD , 4
134granitemoe ,1 ,any ,RMS_NORM+MUL , 5
135granitemoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
136grok ,0 ,any ,MUL+ADD , 4
137grok ,0 ,any ,RMS_NORM+MUL , 5
138grok ,0 ,any ,RMS_NORM+MUL+ADD , 4
139grok ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
140grovemoe ,1 ,any ,ADD+ADD , 2
141grovemoe ,1 ,any ,MUL+ADD , 8
142grovemoe ,1 ,any ,RMS_NORM+MUL , 9
143hunyuan-dense ,0 ,any ,RMS_NORM+MUL , 9
144hunyuan-moe ,1 ,any ,ADD+ADD , 2
145hunyuan-moe ,1 ,any ,MUL+ADD , 4
146hunyuan-moe ,1 ,any ,RMS_NORM+MUL , 9
147hunyuan-moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
148hunyuan_vl ,0 ,any ,RMS_NORM+MUL , 9
149hy_v3 ,0 ,any ,ADD+ADD , 2
150hy_v3 ,0 ,any ,MUL+ADD , 4
151hy_v3 ,0 ,any ,RMS_NORM+MUL , 9
152hy_v3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 2
153hy_v4 ,0 ,any ,MUL+ADD , 2
154hy_v4 ,0 ,any ,NORM+MUL+ADD , 1
155hy_v4 ,0 ,any ,RMS_NORM+MUL , 9
156hy_v4 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
157internlm2 ,0 ,any ,RMS_NORM+MUL , 5
158jais ,0 ,any ,NORM+MUL+ADD , 5
159jais2 ,0 ,any ,NORM+MUL+ADD , 5
160jamba ,0 ,any ,RMS_NORM+MUL , 8
161k2-horizon ,0 ,any ,RMS_NORM+MUL , 4
162k2-horizon ,0 ,any ,ADD+ADD , 1
163k2-horizon ,0 ,any ,MUL+ADD , 2
164k2-horizon ,0 ,any ,RMS_NORM+MUL , 4
165k2-horizon ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
166kimi-k3 ,0 ,any ,GATED_DELTA_NET+CPY , 1
167kimi-k3 ,0 ,any ,MUL+ADD , 2
168kimi-k3 ,0 ,any ,RMS_NORM+MUL , 17
169kimi-k3 ,0 ,any ,RMS_NORM+SCALE , 2
170kimi-k3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
171kimi-linear ,0 ,any ,ADD+ADD , 1
172kimi-linear ,0 ,any ,GATED_DELTA_NET+CPY , 1
173kimi-linear ,0 ,any ,MUL+ADD , 2
174kimi-linear ,0 ,any ,RMS_NORM+MUL , 7
175kimi-linear ,0 ,any ,RMS_NORM+SCALE , 2
176kimi-linear ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
177kolibri1 ,0 ,any ,MUL+ADD , 4
178kolibri1 ,0 ,any ,RMS_NORM+MUL , 10
179kolibri1 ,0 ,any ,RMS_NORM+MUL+ADD , 3
180laguna ,0 ,any ,ADD+ADD , 1
181laguna ,0 ,any ,MUL+ADD , 2
182laguna ,0 ,any ,RMS_NORM+MUL , 9
183laguna ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
184lfm2 ,0 ,any ,RMS_NORM+MUL , 7
185lfm2moe ,1 ,any ,MUL+ADD , 2
186lfm2moe ,1 ,any ,RMS_NORM+MUL , 7
187lfm2moe ,1 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 1
188lfm3 ,0 ,any ,RMS_NORM+MUL , 17
189llada ,0 ,any ,RMS_NORM+MUL , 5
190llada-moe ,1 ,any ,MUL+ADD , 4
191llada-moe ,1 ,any ,RMS_NORM+MUL , 9
192llada-moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
193llama ,0 ,any ,RMS_NORM+MUL , 5
194llama ,0 ,any ,MUL+ADD , 4
195llama ,0 ,any ,RMS_NORM+MUL , 5
196llama ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
197llama4 ,0 ,any ,ADD+ADD , 2
198llama4 ,0 ,any ,RMS_NORM+MUL , 9
199maincoder ,0 ,any ,RMS_NORM+MUL , 9
200maion-coder ,0 ,any ,MUL+ADD , 4
201maion-coder ,0 ,any ,RMS_NORM+MUL , 17
202maion-coder ,0 ,any ,RMS_NORM+MUL+ADD , 8
203maion-coder ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
204mamba ,0 ,any ,RMS_NORM+MUL , 3
205mamba2 ,0 ,any ,RMS_NORM+MUL , 5
206maple ,0 ,any ,MUL+ADD , 4
207maple ,0 ,any ,RMS_NORM+MUL , 9
208maple ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
209mellum ,0 ,any ,MUL+ADD , 4
210mellum ,0 ,any ,RMS_NORM+MUL , 9
211mellum ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
212metis16 ,0 ,any ,MUL+ADD , 8
213metis16 ,0 ,any ,RMS_NORM+MUL , 11
214mimo2 ,0 ,any ,MUL+ADD , 4
215mimo2 ,0 ,any ,RMS_NORM+MUL , 5
216mimo2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
217minicpm ,0 ,any ,RMS_NORM+MUL , 5
218minicpm ,0 ,any ,MUL+ADD , 4
219minicpm ,0 ,any ,RMS_NORM+MUL , 5
220minicpm ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
221minicpm3 ,0 ,any ,RMS_NORM+MUL , 9
222minimax-01 ,0 ,any ,MUL+ADD , 4
223minimax-01 ,0 ,any ,RMS_NORM+MUL , 6
224minimax-01 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
225minimax-m2 ,0 ,any ,MUL+ADD , 4
226minimax-m2 ,0 ,any ,RMS_NORM+MUL , 9
227minimax-m2 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
228minimax-m3 ,0 ,any ,ADD+ADD , 1
229minimax-m3 ,0 ,any ,MUL+ADD , 2
230minimax-m3 ,0 ,any ,RMS_NORM+MUL , 11
231minimax-m3 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
232mistral-large4 ,0 ,any ,ADD+ADD , 3
233mistral-large4 ,0 ,any ,MUL+ADD , 6
234mistral-large4 ,0 ,any ,NORM+MUL+ADD , 6
235mistral-large4 ,0 ,any ,RMS_NORM+MUL , 12
236mistral3 ,0 ,any ,RMS_NORM+MUL , 5
237mistral3 ,0 ,any ,MUL+ADD , 4
238mistral3 ,0 ,any ,RMS_NORM+MUL , 5
239mistral3 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
240mistral4 ,0 ,any ,ADD+ADD , 1
241mistral4 ,0 ,any ,MUL+ADD , 2
242mistral4 ,0 ,any ,RMS_NORM+MUL , 9
243mistral4 ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS , 1
244mpt ,0 ,any ,NORM+MUL+ADD , 5
245muse-glimmer ,0 ,any ,RMS_NORM+MUL , 10
246muse-glimmer ,0 ,any ,RMS_NORM+MUL+ADD , 3
247muse-spark ,0 ,prefill ,MUL+ADD , 2
248muse-spark ,0 ,decode ,MUL+ADD , 4
249muse-spark ,0 ,any ,RMS_NORM+MUL , 14
250muse-spark ,0 ,any ,UNARY+ADD+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
251nanbeige ,0 ,any ,RMS_NORM+MUL , 5
252nemotron ,0 ,any ,NORM+MUL+ADD , 5
253nemotron_h ,0 ,any ,RMS_NORM+MUL , 5
254nemotron_h_moe ,1 ,any ,RMS_NORM+MUL , 5
255olmo2 ,0 ,any ,RMS_NORM+MUL , 5
256olmo2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
257olmoe ,1 ,any ,MUL+ADD , 4
258olmoe ,1 ,any ,RMS_NORM+MUL , 9
259olmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
260openelm ,0 ,any ,RMS_NORM+MUL , 9
261orion ,0 ,any ,NORM+MUL+ADD , 5
262paddleocr ,0 ,any ,RMS_NORM+MUL , 5
263pangu-embedded ,0 ,any ,RMS_NORM+MUL , 5
264phi2 ,0 ,any ,ADD+ADD , 2
265phi2 ,0 ,any ,NORM+MUL+ADD , 3
266phi3 ,0 ,any ,RMS_NORM+MUL , 5
267phimoe ,1 ,any ,MUL+ADD , 4
268phimoe ,1 ,any ,RMS_NORM+MUL+ADD , 5
269phimoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
270plamo ,0 ,any ,ADD+ADD , 2
271plamo ,0 ,any ,RMS_NORM+MUL , 3
272plamo2 ,0 ,any ,RMS_NORM+MUL , 10
273plamo2 ,0 ,any ,RMS_NORM+MUL+ADD , 4
274plamo2 ,0 ,any ,SSM_CONV+UNARY , 1
275plamo3 ,0 ,any ,RMS_NORM+MUL , 9
276plamo3 ,0 ,any ,RMS_NORM+MUL+ADD , 4
277pockettts ,0 ,any ,NORM+MUL+ADD , 5
278qwen ,0 ,any ,RMS_NORM+MUL , 5
279qwen2 ,0 ,any ,RMS_NORM+MUL , 5
280qwen2moe ,1 ,any ,ADD+ADD , 2
281qwen2moe ,1 ,any ,MUL+ADD , 4
282qwen2moe ,1 ,any ,RMS_NORM+MUL , 5
283qwen2moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS , 2
284qwen2vl ,0 ,any ,RMS_NORM+MUL , 5
285qwen3 ,0 ,any ,RMS_NORM+MUL , 9
286qwen35 ,0 ,any ,GATED_DELTA_NET+CPY , 1
287qwen35 ,0 ,any ,RMS_NORM+MUL , 8
288qwen35 ,0 ,any ,RMS_NORM+SCALE , 2
289qwen35 ,0 ,any ,SSM_CONV+UNARY , 1
290qwen35moe ,1 ,any ,ADD+ADD , 2
291qwen35moe ,1 ,any ,GATED_DELTA_NET+CPY , 1
292qwen35moe ,1 ,any ,MUL+ADD , 4
293qwen35moe ,1 ,any ,RMS_NORM+MUL , 8
294qwen35moe ,1 ,any ,RMS_NORM+SCALE , 2
295qwen35moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
296qwen35moe ,1 ,any ,SSM_CONV+UNARY , 1
297qwen3moe ,1 ,any ,MUL+ADD , 4
298qwen3moe ,1 ,any ,RMS_NORM+MUL , 9
299qwen3moe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
300qwen3next ,0 ,any ,ADD+ADD , 2
301qwen3next ,0 ,any ,GATED_DELTA_NET+CPY , 1
302qwen3next ,0 ,any ,MUL+ADD , 4
303qwen3next ,0 ,any ,RMS_NORM+MUL , 8
304qwen3next ,0 ,any ,RMS_NORM+SCALE , 2
305qwen3next ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
306qwen3next ,0 ,any ,SSM_CONV+UNARY , 1
307qwen3tts ,0 ,any ,RMS_NORM+MUL , 9
308qwen3vl ,0 ,any ,RMS_NORM+MUL , 9
309qwen3vlmoe ,1 ,any ,MUL+ADD , 4
310qwen3vlmoe ,1 ,any ,RMS_NORM+MUL , 9
311qwen3vlmoe ,1 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
312qwen4exp ,0 ,any ,ADD+ADD+ADD , 2
313qwen4exp ,0 ,any ,GATED_DELTA_NET+CPY , 1
314qwen4exp ,0 ,any ,MUL+ADD , 4
315qwen4exp ,0 ,any ,RMS_NORM+MUL , 13
316qwen4exp ,0 ,any ,RMS_NORM+SCALE , 2
317qwen4exp ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
318qwen4exp ,0 ,any ,SSM_CONV+UNARY , 1
319refact ,0 ,any ,RMS_NORM+MUL , 5
320refact ,0 ,any ,RMS_NORM+MUL , 5
321rnd1 ,0 ,any ,MUL+ADD , 4
322rnd1 ,0 ,any ,RMS_NORM+MUL , 9
323rnd1 ,0 ,any ,SOFT_MAX+ARGSORT+GET_ROWS+SUM_ROWS+CLAMP+DIV, 2
324seed_oss ,0 ,any ,RMS_NORM+MUL , 5
325smallthinker ,0 ,any ,MUL+ADD , 4
326smallthinker ,0 ,any ,RMS_NORM+MUL , 5
327smollm3 ,0 ,any ,RMS_NORM+MUL , 5
328spark2_5 ,0 ,any ,RMS_NORM+MUL , 5
329stablelm ,0 ,any ,NORM+MUL , 4
330stablelm ,0 ,any ,NORM+MUL+ADD , 5
331starcoder ,0 ,any ,NORM+MUL+ADD , 5
332starcoder2 ,0 ,any ,NORM+MUL+ADD , 5
333talkie ,0 ,any ,ADD+ADD , 2
334xverse ,0 ,any ,RMS_NORM+MUL , 5