Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
e95dae18d64ae4471d61a9dc87880a64e0e5c86e
llama.cpp/ggml/src/ggml-opencl/kernels
T
History
Gaurav Garg e95dae18d6 Remove padding and multiple D2D copies for MTP (#24086) 
* Make ggml_gated_delta_net take only the initial recurrent state (D, 1, n_seqs) and passes the snapshot count K as an op parameter instead of inferring it from state->ne[1].

Remove the padding hack and copy all emitted snapshots into the recurrent cache with a single strided ggml_cpy

* Make GDN changes in all backends. Address review comments.

* Fix CI build errors
2026-06-10 23:21:16 +05:30
..
add_id.cl
opencl: add swiglu_oai and add_id (#15121)
2025-08-06 12:12:17 -07:00
add.cl
opencl: allow mixed f16/f32 add (#15140)
2025-08-12 02:42:41 -07:00
argsort.cl
opencl: add new ops - argsort, div, sub, addrows, sigmoid, group_norm (#13787)
2025-05-27 12:56:08 -07:00
clamp.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
concat.cl
opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)
2026-06-05 13:45:25 -07:00
conv2d_f16_f32.cl
opencl: add conv2d kernel (#14403)
2025-07-21 10:03:19 -07:00
conv2d.cl
opencl: add conv2d kernel (#14403)
2025-07-21 10:03:19 -07:00
cpy.cl
opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)
2026-06-05 13:45:25 -07:00
cumsum.cl
opencl: add cumsum op (#18981)
2026-03-11 22:03:07 -07:00
cvt.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
diag_mask_inf.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
diag.cl
opencl: add neg, exp and diag (#20127)
2026-03-05 21:16:39 -08:00
div.cl
opencl: add f16 for add, sub, mul, div (#14984)
2025-08-01 13:15:44 +02:00
embed_kernel.py
Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)
2024-12-13 12:23:52 -08:00
exp.cl
opencl: add neg, exp and diag (#20127)
2026-03-05 21:16:39 -08:00
expm1.cl
opencl: refactor expm1 and softplus (#19404)
2026-02-17 14:47:18 -08:00
fill.cl
opencl: add FILL op support (#18682)
2026-01-07 22:04:50 -08:00
flash_attn_f16.cl
opencl: add attn sinks support for FA kernels (#15706)
2025-09-01 23:26:53 -07:00
flash_attn_f32_f16.cl
opencl: add attn sinks support for FA kernels (#15706)
2025-09-01 23:26:53 -07:00
flash_attn_f32.cl
opencl: fix FA for f32 (#16584)
2025-10-15 10:48:28 -07:00
gated_delta_net.cl
Remove padding and multiple D2D copies for MTP (#24086)
2026-06-10 23:21:16 +05:30
gelu.cl
opencl: add GELU_ERF (#14476)
2025-07-04 23:24:56 -07:00
gemm_moe_mxfp4_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_mxfp4_f32.cl
opencl: transposed gemm/gemv moe kernel with mxfp4,f32 (#16602)
2025-10-17 17:55:32 -07:00
gemm_moe_q4_0_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q4_1_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q4_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q5_0_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q5_1_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q5_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_moe_q6_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemm_noshuffle_iq4_nl_f32.cl
opencl: add iq4_nl support (#22272)
2026-04-25 21:21:58 -07:00
gemm_noshuffle_q4_0_f32.cl
opencl: refactor Adreno q4_0 (#22335)
2026-05-05 09:38:57 -07:00
gemm_noshuffle_q4_1_f32.cl
opencl: add optimized q4_1 mm kernel for adreno (#19840)
2026-03-02 19:49:41 -08:00
gemm_noshuffle_q4_k_f32.cl
opencl: add q4_K gemm and gemv kernels for Adreno (#20919)
2026-03-30 12:19:16 -07:00
gemm_noshuffle_q5_k_f32.cl
opencl: add q5_K gemm and gemv kernels for Adreno (#21595)
2026-04-16 12:08:33 -07:00
gemm_noshuffle_q6_k_f32.cl
opencl: add q6_K gemm and gemv kernels for Adreno (#20089)
2026-03-23 12:44:18 -07:00
gemm_noshuffle_q8_0_f32.cl
opencl: refactor Adreno q4_0 (#22335)
2026-05-05 09:38:57 -07:00
gemm_xmem_f16_f32_os8.cl
opencl: add opt-in Adreno xmem F16xF32 GEMM for prefill (#22755)
2026-05-12 13:10:37 -07:00
gemv_moe_mxfp4_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_mxfp4_f32.cl
opencl: transposed gemm/gemv moe kernel with mxfp4,f32 (#16602)
2025-10-17 17:55:32 -07:00
gemv_moe_q4_0_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q4_1_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q4_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q5_0_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q5_1_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q5_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_moe_q6_k_f32_ns.cl
opencl: generalize Adreno MoE kernels on M (#23449)
2026-05-22 17:08:41 -07:00
gemv_noshuffle_iq4_nl_f32.cl
opencl: add iq4_nl support (#22272)
2026-04-25 21:21:58 -07:00
gemv_noshuffle_q4_0_f32_spec.cl
opencl: refactor Adreno q4_0 (#22335)
2026-05-05 09:38:57 -07:00
gemv_noshuffle_q4_0_f32.cl
opencl: refactor Adreno q4_0 (#22335)
2026-05-05 09:38:57 -07:00
gemv_noshuffle_q4_1_f32.cl
opencl: add optimized q4_1 mm kernel for adreno (#19840)
2026-03-02 19:49:41 -08:00
gemv_noshuffle_q4_k_f32.cl
opencl: add q4_K gemm and gemv kernels for Adreno (#20919)
2026-03-30 12:19:16 -07:00
gemv_noshuffle_q5_k_f32.cl
opencl: add q5_K gemm and gemv kernels for Adreno (#21595)
2026-04-16 12:08:33 -07:00
gemv_noshuffle_q6_k_f32.cl
opencl: add q6_K gemm and gemv kernels for Adreno (#20089)
2026-03-23 12:44:18 -07:00
gemv_noshuffle_q8_0_f32.cl
opencl: refactor Adreno q4_0 (#22335)
2026-05-05 09:38:57 -07:00
get_rows.cl
opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)
2026-06-05 13:45:25 -07:00
glu.cl
opencl: add swiglu_oai and add_id (#15121)
2025-08-06 12:12:17 -07:00
group_norm.cl
OpenCL: add fused group_norm/norm, mul, add (#15314)
2025-08-26 23:36:05 -07:00
im2col_f16.cl
opencl: fix im2col when KW!=KH (#14803)
2025-07-21 13:55:10 -07:00
im2col_f32.cl
opencl: fix im2col when KW!=KH (#14803)
2025-07-21 13:55:10 -07:00
l2_norm.cl
opencl: fix l2_norm (#20480)
2026-03-13 22:18:52 -07:00
mean.cl
opencl: optimize mean and sum_row kernels (#19614)
2026-02-17 13:56:09 -08:00
moe_reorder_b.cl
opencl: Adreno optimization for MoE - MxFP4 (#22301)
2026-05-01 23:02:24 -07:00
moe_sort_by_expert.cl
opencl: Adreno optimization for MoE - MxFP4 (#22301)
2026-05-01 23:02:24 -07:00
mul_mat_f16_f32.cl
opencl: add tiled mul_mat_f16_f32 (#14535)
2025-07-10 14:58:12 -07:00
mul_mm_f16_f32_kq_kqv.cl
opencl: add kernel to handle mat mul in attention to improve encoding speed (#17181)
2025-11-15 17:33:10 -08:00
mul_mm_f16_f32_l4_lm.cl
opencl: fix boundary handling for mul_mm (#16875)
2025-10-30 16:00:20 -07:00
mul_mm_f32_f32_l4_lm.cl
opencl: fix boundary handling for mul_mm (#16875)
2025-10-30 16:00:20 -07:00
mul_mm_iq4_nl_f32_l4_lm.cl
opencl: add iq4_nl support (#22272)
2026-04-25 21:21:58 -07:00
mul_mm_q4_0_f32_l4_lm.cl
opencl: add basic support for q4_1 (#19534)
2026-02-12 14:52:37 -08:00
mul_mm_q4_1_f32_l4_lm.cl
opencl: add basic support for q4_1 (#19534)
2026-02-12 14:52:37 -08:00
mul_mm_q4_k_f32_l4_lm.cl
opencl: add flattened Q4_K mv and general Q4_K mm (#20773)
2026-03-22 22:45:11 -07:00
mul_mm_q5_0_f32_l4_lm.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mm_q5_1_f32_l4_lm.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mm_q5_k_f32_l4_lm.cl
opencl: add basic support for q5_k (#21593)
2026-04-11 01:46:19 -07:00
mul_mm_q6_k_f32_l4_lm.cl
opencl: add general Q6_K mm and Q4_K mv (#19347)
2026-02-11 10:33:13 -08:00
mul_mm_q8_0_f32_l4_lm.cl
opencl: fix boundary handling for mul_mm (#16875)
2025-10-30 16:00:20 -07:00
mul_mv_f16_f16.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_f16_f32_1row.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_f16_f32_l4.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_f16_f32.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_f32_f32.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_id_mxfp4_f32_flat.cl
opencl: optimize mxfp4 kernels (#16037)
2025-09-18 12:03:34 -07:00
mul_mv_id_mxfp4_f32.cl
opencl: add initial mxfp4 support via mv (#15270)
2025-08-15 09:52:14 -07:00
mul_mv_id_q4_0_f32_8x_flat.cl
opencl: add mul_mv_id_q4_0_f32_8x_flat (#14003)
2025-06-10 16:55:58 -07:00
mul_mv_id_q8_0_f32_flat.cl
opencl: initial q8_0 mv support (#15732)
2025-09-21 14:48:44 -07:00
mul_mv_id_q8_0_f32.cl
opencl: initial q8_0 mv support (#15732)
2025-09-21 14:48:44 -07:00
mul_mv_iq4_nl_f32_flat.cl
opencl: add iq4_nl support (#22272)
2026-04-25 21:21:58 -07:00
mul_mv_iq4_nl_f32.cl
opencl: add iq4_nl support (#22272)
2026-04-25 21:21:58 -07:00
mul_mv_mxfp4_f32_flat.cl
opencl: optimize mxfp4 kernels (#16037)
2025-09-18 12:03:34 -07:00
mul_mv_mxfp4_f32.cl
opencl: add initial mxfp4 support via mv (#15270)
2025-08-15 09:52:14 -07:00
mul_mv_q4_0_f32_1d_8x_flat.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_q4_0_f32_1d_16x_flat.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_q4_0_f32_8x_flat.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_q4_0_f32_v.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_q4_0_f32.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
mul_mv_q4_1_f32_flat.cl
opencl: add basic support for q4_1 (#19534)
2026-02-12 14:52:37 -08:00
mul_mv_q4_1_f32.cl
opencl: add basic support for q4_1 (#19534)
2026-02-12 14:52:37 -08:00
mul_mv_q4_k_f32_flat.cl
opencl: add flattened Q4_K mv and general Q4_K mm (#20773)
2026-03-22 22:45:11 -07:00
mul_mv_q4_k_f32.cl
opencl: add general Q6_K mm and Q4_K mv (#19347)
2026-02-11 10:33:13 -08:00
mul_mv_q5_0_f32_flat.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mv_q5_0_f32.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mv_q5_1_f32_flat.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mv_q5_1_f32.cl
opencl: add basic support for q5_0 and q5_1 (#23548)
2026-06-01 10:06:50 -07:00
mul_mv_q5_k_f32_flat.cl
opencl: add basic support for q5_k (#21593)
2026-04-11 01:46:19 -07:00
mul_mv_q5_k_f32.cl
opencl: add basic support for q5_k (#21593)
2026-04-11 01:46:19 -07:00
mul_mv_q6_k_f32_flat.cl
opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)
2026-06-05 13:45:25 -07:00
mul_mv_q6_k_f32.cl
opencl: add flattened q6_K mv (#19054)
2026-01-26 19:36:24 -08:00
mul_mv_q8_0_f32_flat.cl
opencl: initial q8_0 mv support (#15732)
2025-09-21 14:48:44 -07:00
mul_mv_q8_0_f32.cl
opencl: initial q8_0 mv support (#15732)
2025-09-21 14:48:44 -07:00
mul.cl
opencl: add f16 for add, sub, mul, div (#14984)
2025-08-01 13:15:44 +02:00
neg.cl
opencl: add neg, exp and diag (#20127)
2026-03-05 21:16:39 -08:00
norm.cl
OpenCL: add fused group_norm/norm, mul, add (#15314)
2025-08-26 23:36:05 -07:00
pad.cl
opencl: support pad_ext (#15888)
2025-09-30 10:45:45 -07:00
relu.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
repeat.cl
opencl: refactor some ops, concat, repeat, tanh and scale (#19226)
2026-02-02 15:54:43 -08:00
rms_norm.cl
opencl: fix rms_norm_mul (#17250)
2025-11-15 17:40:14 -08:00
rope.cl
opencl: support imrope (#16914)
2025-11-03 11:47:57 -08:00
scale.cl
opencl: refactor some ops, concat, repeat, tanh and scale (#19226)
2026-02-02 15:54:43 -08:00
set_rows.cl
opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)
2025-11-10 15:00:13 -08:00
sigmoid.cl
opencl: add new ops - argsort, div, sub, addrows, sigmoid, group_norm (#13787)
2025-05-27 12:56:08 -07:00
silu.cl
opencl: split ggml-opencl.cl into multiple files and cleanup (#12886)
2025-04-15 12:26:00 -07:00
softmax_4_f16.cl
opencl: support sink in soft_max (attn sinks) (#15152)
2025-08-07 21:47:03 -07:00
softmax_4_f32.cl
opencl: support sink in soft_max (attn sinks) (#15152)
2025-08-07 21:47:03 -07:00
softmax_f16.cl
opencl: support sink in soft_max (attn sinks) (#15152)
2025-08-07 21:47:03 -07:00
softmax_f32.cl
opencl: support sink in soft_max (attn sinks) (#15152)
2025-08-07 21:47:03 -07:00
softplus.cl
opencl: refactor expm1 and softplus (#19404)
2026-02-17 14:47:18 -08:00
solve_tri.cl
OpenCL: add SOLVE_TRI op support (#18846)
2026-01-15 11:17:17 -08:00
sqr.cl
opencl: add sqr, sqrt, mean and ssm_conv (#17476)
2025-11-26 13:29:58 -08:00
sqrt.cl
opencl: add sqr, sqrt, mean and ssm_conv (#17476)
2025-11-26 13:29:58 -08:00
ssm_conv.cl
opencl: add sqr, sqrt, mean and ssm_conv (#17476)
2025-11-26 13:29:58 -08:00
sub.cl
opencl: add f16 for add, sub, mul, div (#14984)
2025-08-01 13:15:44 +02:00
sum_rows.cl
opencl: optimize mean and sum_row kernels (#19614)
2026-02-17 13:56:09 -08:00
tanh.cl
opencl: refactor some ops, concat, repeat, tanh and scale (#19226)
2026-02-02 15:54:43 -08:00
transpose.cl
opencl: add optimized q4_1 mm kernel for adreno (#19840)
2026-03-02 19:49:41 -08:00
tri.cl
opencl: add TRI op support (#18979)
2026-01-21 22:05:54 -08:00
tsembd.cl
ggml : fix padding in timestep embedding kernels (#15932)
2025-09-16 15:25:57 +02:00
upscale.cl
opencl : update upscale to support align corners (#14488)
2025-07-02 09:07:42 +02:00