Titaniumtown 6b5c2efb4e sycl: *glu flat path (#26354) ...

* tests: add SWIGLU perf cases

perf mode had no GLU coverage. Adds SWIGLU at 17408 columns, 512 and
2048 tokens, f16 and f32, with the operands both fused and split.

* sycl: consolidate fused-GLU kernels

They differed only in which op_* they called, so take the op as an argument and share a common launcher.
Their block sizes were all 256, so launch geometry is unchanged;
SYCL_GELU_BLOCK_SIZE and SYCL_SILU_BLOCK_SIZE lose their last users so are dropped.

* sycl: contiguous fast path for the fused GLU ops

o0 == n and o1 == n collapse the de-interleave index math to the
identity, so dispatch a flat kernel in that case. It fires for
ggml_glu_split with packed operands; a fused [gate|up] tensor keeps the
strided path. test-backend-ops perf -o SWIGLU on an Arc Pro B70: split
+14% f16 and +4% f32, fused unchanged.

2026-08-07 08:24:40 +03:00

..

dpct

[SYCL] add dev2dev memcpy by SYCL API (#24476)

2026-06-17 17:21:34 +03:00

template-instances

sycl : add flash-attn support for head size 512 (#21654)

2026-04-09 09:36:48 +03:00

add-id.cpp

sycl : fix wrong variable check by assert (#20903)

2026-03-25 11:48:37 +02:00

add-id.hpp

[SYCL] Support gpt-oss by OPs add-id, mul_mat for mxfp4, swiglu_oai (#17826)

2025-12-15 10:35:15 +08:00

backend.hpp

sycl: fuse RMS_NORM + MUL (#26015)

2026-07-31 09:17:53 +03:00

binbcast.cpp

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

2026-06-22 14:09:02 +03:00

binbcast.hpp

[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)

2025-10-12 21:53:35 +08:00

CMakeLists.txt

sycl(build): parallelize ocloc invocations (#25903)

2026-07-27 15:33:11 +03:00

col2im-1d.cpp

[SYCL] support op col2im_1d (#25264)

2026-07-07 11:07:46 +03:00

col2im-1d.hpp

[SYCL] support op col2im_1d (#25264)

2026-07-07 11:07:46 +03:00

common.cpp

[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO (#24719)

2026-06-18 11:18:26 +03:00

common.hpp

sycl: fix classification of iGPUs (#26105)

2026-08-02 15:10:32 +08:00

concat.cpp

sycl: parallelize the non-contiguous concat kernel (#25852)

2026-08-04 10:08:05 +08:00

concat.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

conv2d-dw.cpp

sycl : support kernel type fp16 for conv2d_dw (#25653)

2026-07-15 10:31:10 +03:00

conv2d-dw.hpp

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

2026-06-18 09:40:03 +03:00

conv2d-transpose.cpp

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

2026-06-18 09:40:03 +03:00

conv2d-transpose.hpp

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

2026-06-18 09:40:03 +03:00

conv2d.cpp

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

2026-06-18 09:40:03 +03:00

conv2d.hpp

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

2026-06-18 09:40:03 +03:00

conv3d.cpp

sycl : fix the failed UT cases of conv_3d (#24900)

2026-06-25 08:27:58 +03:00

conv3d.hpp

[SYCL] Add conv_3d (#24691)

2026-06-17 17:20:01 +03:00

conv.cpp

Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910)

2025-09-12 09:15:12 +08:00

conv.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

convert.cpp

[SYCL] Support q2 mul_mat (#26231)

2026-07-31 09:19:41 +03:00

convert.hpp

sycl: Improve mul_mat_id memory efficiency and add BF16 fast path (#22119)

2026-04-22 20:32:56 +08:00

count-equal.cpp

[SYCL] supprt Flash Attention for fp32/fp16/Q4/Q5/Q8 (#20190)

2026-03-08 12:00:07 +08:00

count-equal.hpp

[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)

2025-10-12 21:53:35 +08:00

cpy.cpp

[SYCL] support the missed types in cpy (#26005)

2026-07-31 10:25:16 +03:00

cpy.hpp

[SYCL] support the missed types in cpy (#26005)

2026-07-31 10:25:16 +03:00

cross_entropy_loss.cpp

[SYCL] support OP cross_entropy_loss, cross_entropy_loss_back (#25236)

2026-07-07 10:48:50 +03:00

cross_entropy_loss.hpp

[SYCL] support OP cross_entropy_loss, cross_entropy_loss_back (#25236)

2026-07-07 10:48:50 +03:00

cumsum.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

cumsum.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

dequantize.hpp

[SYCL] Support q2 mul_mat (#26231)

2026-07-31 09:19:41 +03:00

diag.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

diag.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

dmmv.cpp

sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (#25690)

2026-07-17 08:49:49 +03:00

dmmv.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

dsv4-hc.cpp

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

2026-08-07 08:22:23 +03:00

dsv4-hc.hpp

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

2026-08-07 08:22:23 +03:00

element_wise.cpp

sycl: *glu flat path (#26354)

2026-08-07 08:24:40 +03:00

element_wise.hpp

sycl : implement xielu op (#25550)

2026-07-15 10:29:12 +03:00

fattn-buffers.cpp

SYCL: reduce allocation overhead during flash attention (#22732)

2026-05-09 09:30:39 +03:00

fattn-buffers.hpp

SYCL: reduce allocation overhead during flash attention (#22732)

2026-05-09 09:30:39 +03:00

fattn-common.hpp

[SYCL] Support Q4_1, Q5_0, Q5_1 in Flash-attention (#23812)

2026-06-01 09:53:53 +03:00

fattn-mkl.cpp

SYCL: add oneMKL GEMM flash attention for XMX-accelerated prompt proc… (#25025)

2026-07-31 10:43:16 +03:00

fattn-onednn.cpp

Extended SYCL oneDNN SDPA to non-FP16 KV caches (Q4_0–Q8_0 and FP32) (#25874)

2026-08-04 10:07:23 +08:00

fattn-onednn.hpp

[SYCL] Flash Attention with XMX engine via oneDNN (#25222)

2026-07-15 10:26:53 +03:00

fattn-tile.cpp

sycl : add flash-attn support for head size 512 (#21654)

2026-04-09 09:36:48 +03:00

fattn-tile.hpp

sycl : add flash-attn support for head size 512 (#21654)

2026-04-09 09:36:48 +03:00

fattn-vec.hpp

sycl : fix error Error OP FLASH_ATTN_EXT on arc770 (#26441)

2026-08-07 08:17:56 +03:00

fattn.cpp

Extended SYCL oneDNN SDPA to non-FP16 KV caches (Q4_0–Q8_0 and FP32) (#25874)

2026-08-04 10:07:23 +08:00

fattn.hpp

SYCL: add oneMKL GEMM flash attention for XMX-accelerated prompt proc… (#25025)

2026-07-31 10:43:16 +03:00

fill.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

fill.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

fusion.cpp

sycl: fuse RMS_NORM + MUL (#26015)

2026-07-31 09:17:53 +03:00

fusion.hpp

sycl: fuse RMS_NORM + MUL (#26015)

2026-07-31 09:17:53 +03:00

gated_delta_net.cpp

Remove padding and multiple D2D copies for MTP (#24086)

2026-06-10 23:21:16 +05:30

gated_delta_net.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

gemm.hpp

sycl: Improve mul_mat_id memory efficiency and add BF16 fast path (#22119)

2026-04-22 20:32:56 +08:00

getrows.cpp

sycl : fix get_rows Q2_K, Q4_K, Q5_K (#25656)

2026-07-15 10:32:28 +03:00

getrows.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

ggml-sycl.cpp

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

2026-08-07 08:22:23 +03:00

gla.cpp

Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910)

2025-09-12 09:15:12 +08:00

gla.hpp

SYCL: Add gated linear attention kernel (#11175)

2025-01-15 11:20:17 +08:00

im2col.cpp

[SYCL] Add OP im2col_3d (#22903)

2026-05-11 08:01:47 +03:00

im2col.hpp

[SYCL] Add OP im2col_3d (#22903)

2026-05-11 08:01:47 +03:00

lightning-indexer.cpp

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

2026-08-07 08:22:23 +03:00

lightning-indexer.hpp

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

2026-08-07 08:22:23 +03:00

mmq.cpp

Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910)

2025-09-12 09:15:12 +08:00

mmq.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

mmvq.cpp

[SYCL] Support q2 mul_mat (#26231)

2026-07-31 09:19:41 +03:00

mmvq.hpp

sycl: support reordered Q4_K/Q5_K/Q6_K MoE MUL_MAT_ID (#24452)

2026-06-16 08:35:00 +03:00

norm.cpp

sycl: fuse RMS_NORM + MUL (#26015)

2026-07-31 09:17:53 +03:00

norm.hpp

sycl: fuse RMS_NORM + MUL (#26015)

2026-07-31 09:17:53 +03:00

outprod.cpp

sycl : support MUL_MAT and OUT_PROD with Q1_0 (#24721)

2026-06-18 11:17:37 +03:00

outprod.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

pad_reflect_1d.cpp

refactor pad_reflect_1d to make the UT case pass (#17204)

2025-11-28 08:50:56 +08:00

pad_reflect_1d.hpp

refactor pad_reflect_1d to make the UT case pass (#17204)

2025-11-28 08:50:56 +08:00

pad.cpp

sycl: support non-contiguous input in PAD op (#22148)

2026-05-09 08:05:22 +08:00

pad.hpp

[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)

2025-10-12 21:53:35 +08:00

pool.cpp

[SYCL] add to support pool_1d, move pool_1d/2d code to pool.cpp/hpp (#24584)

2026-06-15 10:01:07 +03:00

pool.hpp

[SYCL] add to support pool_1d, move pool_1d/2d code to pool.cpp/hpp (#24584)

2026-06-15 10:01:07 +03:00

presets.hpp

sycl: *glu flat path (#26354)

2026-08-07 08:24:40 +03:00

quantize.hpp

sycl: refactor quantization to q8_1 (#14815)

2025-07-28 11:05:53 +01:00

quants.hpp

sycl : Optimize Q3_K mul_mat by reorder (#23725)

2026-06-01 09:50:55 +03:00

repeat_back.cpp

SYCL: optimized repeat_back kernel (3× fewer asm instructions, 2× faster)Feature/sycl repeat back opt (#16869)

2025-11-03 09:35:33 +08:00

repeat_back.hpp

sycl: add REPEAT_BACK operation support (#16734)

2025-10-27 09:19:50 +08:00

roll.cpp

sycl: add ROLL operation support (#16665)

2025-10-27 09:20:24 +08:00

roll.hpp

sycl: add ROLL operation support (#16665)

2025-10-27 09:20:24 +08:00

rope.cpp

fix op rope, add rope_back (#20293)

2026-03-11 09:53:34 +08:00

rope.hpp

fix op rope, add rope_back (#20293)

2026-03-11 09:53:34 +08:00

set_rows.cpp

sycl : enhance OP set_rows to support all missed data types (#26515)

2026-08-07 07:52:52 +03:00

set_rows.hpp

SYCL: Initial set_rows kernel implementation (#14562)

2025-07-10 09:29:38 +01:00

set.cpp

SYCL SET operator optimized for F32 tensors (#16350)

2025-10-17 10:36:40 +08:00

set.hpp

SYCL SET operator optimized for F32 tensors (#16350)

2025-10-17 10:36:40 +08:00

softmax.cpp

sycl : clamp softmax input to avoid underflow (#24941)

2026-06-26 15:02:42 +08:00

softmax.hpp

[SYCL] refactor soft_max, add soft_max_back (#16472)

2025-10-09 10:25:11 +03:00

solve_tri.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

solve_tri.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

ssm_conv.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

ssm_conv.hpp

sycl: add SSM_CONV operation support (#16800)

2025-10-28 09:50:33 +08:00

ssm_scan.cpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

ssm_scan.hpp

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

2026-05-07 18:51:33 +03:00

sycl_hw.cpp

[SYCL] Optimize Q4_0 mul_mat for Arc770, add scripts (#22291)

2026-04-25 09:20:14 +03:00

sycl_hw.hpp

[SYCL] Optimize Q4_0 mul_mat for Arc770, add scripts (#22291)

2026-04-25 09:20:14 +03:00

topk-moe.cpp

sycl: add fused top-k MoE (#25217)

2026-07-13 09:56:41 +03:00

topk-moe.hpp

sycl: add fused top-k MoE (#25217)

2026-07-13 09:56:41 +03:00

tsembd.cpp

ggml : fix padding in timestep embedding kernels (#15932)

2025-09-16 15:25:57 +02:00

tsembd.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

type.hpp

sycl : support nvfp4 type in mul_mat (#21227)

2026-04-01 13:54:15 +03:00

upscale.cpp

sycl: disable Q1_0 in backend and cleanup unused variables (#21807)

2026-04-13 09:44:58 +08:00

upscale.hpp

[SYCL] ehance UPSCALE to support all UT cases (#20637)

2026-03-17 10:01:52 +08:00

vecdotq.hpp

[SYCL] Support q2 mul_mat (#26231)

2026-07-31 09:19:41 +03:00

wkv.cpp

Remove support for Nvidia & AMD GPU, because the oneAPI plugin for Nvidia & AMD GPU is unavailable: download/installation channels are out of work. (#19246)

2026-02-02 21:06:21 +08:00

wkv.hpp

llama: Add support for RWKV v7 architecture (#12412)

2025-03-18 07:27:50 +08:00