 Titaniumtown
|
3d93885352
|
sycl: fuse the gated-delta-net state writeback cpy (#26643)
Port of https://github.com/ggml-org/llama.cpp/pull/23940.
Arc Pro B70, Qwen 3.6 27B Q4_K - Medium (48 of its 64 blocks run
gated_delta_net), -ngl 99 -fa 1 -ctk f16 -ctv f16 -b 2048 -ub 2048,
interleaved A/B passes of r=3:
tg128 23.91 / 23.90 / 23.90 -> 24.19 / 24.17 / 24.20 +1.2%
tg128 (rebuild) 23.81 / 23.81 -> 24.09 / 24.10 +1.2%
pp2048 1050.8 / 1053.9 -> 1053.8 / 1054.5 flat
2 seqs, tg128 32.73 / 32.75 -> 33.11 / 33.10 +1.1%
|
2026-08-14 09:00:36 +03:00 |
|
|
|
ad09224658
|
sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)
* sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix abort during test-backend-ops
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
* Regenerate ops.md
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
* Add scope_dbg_print to newly added SYCL ops.
Also add scope_dbg_print to existing ssm_conv op.
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
---------
Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
Co-authored-by: Chun Tao <chun.tao@intel.com>
Co-authored-by: Todd Malsbary <todd.malsbary@intel.com>
|
2026-05-07 18:51:33 +03:00 |
|