SS1618
4db8b7638f
webgpu: add POOL_2D support ( #32250 )
...
* Shader, pipeline, and launcher
* Update docs and add newline to wgsl
* Formatting fixes
2026-11-19 13:35:10 +02:00
Nikhil Jain
140a279874
webgpu : Implement timestep embedding ( #31695 )
...
* Only run webgpu CI on my fork
* Add webgpu only workflow
* resolve merge conflicts
* save state
* save kernel
* add kernel back in
* fix merge issues with kernels
* updates
* update tests
* change invocation count and workgroup to be u32
* clang format
* clang format
* update docs
* format
* remove extra file
2026-11-17 10:41:37 +02:00
Georgi Gerganov and losewayy
29dbbad2b1
ggml : prune ( #29801 )
...
* ggml : prune deprecated API
* cont : bump RPC version
* cont : minor
* ggml : remove outdated documentation from ggml.h
The 172-line comment block at the top of the header has not been updated in a
substantive way since the backend v2 split (Nov 2023) and now documents APIs
that no longer exist:
- `ggml_set_f32()`, `ggml_get_f32_1d()`, `ggml_set_f32_1d()` were removed
- `ggml_conv_1d_1s()`, `ggml_conv_1d_2s()` ops no longer exist
- `ggml_set_param()` no longer takes a context argument
- `ggml_graph_compute_with_ctx()` moved to the CPU backend header
- the optimization API now lives in `ggml-opt.h`
The block also ended with 5 empty `TODO` sections.
Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)
* ggml : remove DIAG_MASK_INF and DIAG_MASK_ZERO (#31946 )
* rpc : bump RPC protocol major version
The tensor op enum is sent over the wire, so removing GGML_OP_ADD1,
GGML_OP_DIAG_MASK_INF and GGML_OP_DIAG_MASK_ZERO shifts the value of every
op that follows them and peers built before and after this change would
misinterpret each other's ops.
The handshake compares the major version for exact equality and ignores the
patch version, so bumping the major version is what rejects incompatible
peers instead of silently misbehaving.
Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)
---------
Co-authored-by: losewayy <1134285612@qq.com >
2026-11-12 20:58:24 +02:00
Leon
af6b5243d6
webgpu: add PAD_REFLECT_1D support ( #31877 )
...
* webgpu : add PAD_REFLECT_1D support
* webgpu: remove redundant PAD_REFLECT_1D contiguity check
* tests: simplify PAD_REFLECT_1D setup
2026-11-11 12:11:06 +02:00
Leon and Masashi Yoshimura
a691b23458
webgpu : add COUNT_EQUAL support ( #31578 )
...
* webgpu : add COUNT_EQUAL support
Assisted-by: Codex
* webgpu : reduce small COUNT_EQUAL inputs in one dispatch
Assisted-by: Codex
* webgpu : simplify COUNT_EQUAL and reuse existing tests
* webgpu : move COUNT_EQUAL pipeline cache declaration
* Update ggml/src/ggml-webgpu/ggml-webgpu.cpp
Co-authored-by: Masashi Yoshimura <yoshimura.masashi.frbs@gmail.com >
* tests : simplify COUNT_EQUAL coverage
---------
Co-authored-by: Masashi Yoshimura <yoshimura.masashi.frbs@gmail.com >
2026-11-08 11:50:09 +02:00
Nikhil Jain
cf659f240b
webgpu : Implement group norm kernel ( #31490 )
...
* Only run webgpu CI on my fork
* Add webgpu only workflow
* Add WebGPU group_norm kernel
* clean up
* resolve merge conflicts
* parameterize data type; clean up cmake changes
* add nullptr check
* clean up webkit experiments
* more cleanup
* more cleanup
* clang format
* Remove unused feature check for WebGPU
* clean up supports_op condition and update documentation
* add perf tests for group_norm
* clean up doc with script and undo change in test-backend-ops
* Do 2d dispatch of workgroups
* Do 2d dispatch of workgroups
* Unstage unrelated changes
* undo docs churn
* add new test case
* undo small change
* undo small change
2026-11-07 10:01:27 +02:00
Leon
553d2c2e7e
webgpu : add MEAN support ( #31591 )
...
Assisted-by: Codex
2026-11-05 10:29:14 +02:00
Leon
713319e284
webgpu: add ARANGE support ( #31455 )
2026-11-03 07:54:00 +02:00
m1el
7347430f44
webgpu : add CONV_2D_DW (depthwise conv2d) kernel ( #25847 )
...
* webgpu : add CONV_2D_DW (depthwise conv2d) kernel
Implement GGML_OP_CONV_2D_DW for the WebGPU backend,
ported from the Vulkan backend's conv2d_dw.comp.
Assisted-by: Claude Opus-4.8
* Remove unnecessary comments in webgpu support
* update supported ops tables, triggered by adding webgpu CONV_2D_DW
2026-07-22 17:24:44 +09:00
Masashi Yoshimura
927dada6c9
ggml-webgpu: Enables running gpt-oss-20b ( #22906 )
...
* Enable to run gpt-oss-20b and refactor mulmat-q
* disable test-backend-ops in ubuntu-24-webgpu
2026-05-12 07:27:40 -07:00
Reese Levine
dd2914dc81
ggml-webgpu: support for SSM_SCAN and disable set_rows error checking ( #22327 )
...
* Implement ssm_scan
* Remove blocking in graph_compute and check for set rows
* Fix bindings
* Update op support
2026-04-25 09:18:15 +03:00
Masashi Yoshimura and Reese Levine
d0a6dfeb28
ggml-webgpu: Add the support of MUL_MAT_ID ( #21147 )
...
* Add mul_mat_id support to WebGPU
* Apply suggestion from @reeselevine
---------
Co-authored-by: Reese Levine <reeselevine1@gmail.com >
2026-04-06 13:08:46 -07:00
Reese Levine
c1258830b2
ggml webgpu: ops support for qwen3.5 (SET, TRI_SOLVE, SSM_CONV, GATED_DELTA_NET) + GET_ROWS optimization ( #20687 )
...
* Implement l2_norm, set, tri
* Add DIAG/SOLVE_TRI
* Add SSM_CONV
* Better get_rows and gated_delta_net to support qwen3.5
* Clean up, update ops.md
* Fix binding_index type for wasm
* Fix read write annotations
* cleanups
2026-03-19 08:45:28 -07:00
Masashi Yoshimura
509a31d00f
ggml-webgpu: Update the RMS_NORM preprocessor and add L2_NORM ( #20665 )
...
* Update the preprocessor of RMS_NORM and add L2_NORM.
* Fix the name of rms_norm to row_norm.
2026-03-18 21:08:59 -07:00
Masashi Yoshimura
ea01d196d7
ggml-webgpu: Add supports for DIAG and TRI ( #20664 )
...
* Add supports for DIAG and TRI.
* Remove extra ttype and add a comment for TRI op.
2026-03-18 21:08:35 -07:00
Masashi Yoshimura
f2ab047f27
ggml-webgpu: Add supports for GGML_OP_REPEAT ( #20230 )
...
* Add GGML_OP_REPEAT to webgpu backend.
* Add i16 support for GGML_OP_REPEAT.
2026-03-11 14:40:36 -07:00
Masashi Yoshimura
541bf37622
Add concat op to webgpu. ( #20068 )
2026-03-04 11:19:00 -08:00
Masashi Yoshimura
11c325c6e0
ggml-webgpu: Add unary op (SQR, SQRT, SIN, COS) support. ( #19700 )
...
* ggml-webgpu: Add unary op (SQR, SQRT, SIN, COS) support.
* Fix to cast the src value to f32 before sin/cos computing.
2026-02-19 09:18:30 -07:00
Reese Levine and Abhijit Ramesh
a89002f07b
ggml webgpu: support for backend sampling ( #18880 )
...
* ggml webgpu: add SOFTPLUS unary operator
Implements SOFTPLUS (log(1 + exp(x))) with f16/f32 support. Uses f32
precision for intermediate calculations to prevent f16 overflow.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* Follow Vulkan backend numerical stability pattern
* ggml webgpu: add EXPM1 unary operator
Implements EXPM1 (exp(x) - 1) with f16/f32 support.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* ggml webgpu: add FLOOR unary operator
Implements FLOOR (rounds down to nearest integer) with f16/f32 support.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* ggml webgpu: add CEIL unary operator
Implements CEIL (rounds up to nearest integer) with f16/f32 support.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* ggml webgpu: add ROUND unary operator
Implements ROUND (rounds to nearest integer) with f16/f32 support.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* ggml webgpu: add TRUNC unary operator
Implements TRUNC (truncates towards zero) with f16/f32 support.
* Add shader implementation and 4 variants (f32/f16, inplace/non-inplace)
* Register pipelines and device support
* docs : update WebGPU support for unary operators (FLOOR, CEIL, ROUND, TRUNC, EXPM1, SOFTPLUS)
* Updates to webgpu get_memory
* Add argmax
* Add argmax,cumsum,sum,sum_rows
* Add necessary CPY/GET_ROWS operators
* Support for argsort using multi-pass strategy
* Update set_rows for i32 indices, move to pre-wgsl
* Port unary operators to pre-wgsl and support FILL
* Implement PAD
* Add support for top-k
* clean up, scope pipeline init mutex
* fix newline
* Add support for log
* Update LOG for better precision, and ops doc
---------
Co-authored-by: Abhijit Ramesh <abhijitramesh2k@gmail.com >
2026-01-16 16:12:43 -08:00
nwyin
e443fbcfa5
ggml webgpu: add CEIL operation support ( #18605 )
...
* ggml-webgpu: add CEIL operation support
Add support for the CEIL unary operation in the WebGPU backend:
- Add CEIL_FUNC shader template in unary_op.wgsl
- Add 4 shader variants (f32, f16, inplace versions)
- Initialize CEIL pipelines in ggml-webgpu.cpp
- Register CEIL in supports_op function
* docs: update WebGPU ops support for CEIL
2026-01-05 11:38:57 -08:00
fd57b24c0f
ggml webgpu: unary op suppport, code refactoring, ops support ( #17764 )
...
* Squashed commit of the following:
commit b3c6bf4b0450d8d452b934df27a0fb7cb53cd755
Author: Abhijit Ramesh <abhijitramesh2k@gmail.com >
Date: Mon Dec 1 18:29:00 2025 -0800
ggml webgpu: fix xielu parameter passing (#11 )
The XIELU operation was incorrectly using static_cast to convert
float parameters to uint32_t, which converted numeric values instead
of preserving IEEE 754 bit patterns. This caused incorrect values
to be interpreted by the GPU shader.
* Use reinterpret_cast to preserve float bit patterns when passing
through uint32_t params buffer
* Update WGSL shader parameter types from u32 to f32
* Re-enable XIELU support (was disabled due to numerical issues)
Fixes NMSE test failures for XIELU operation on WebGPU backend.
commit 5ca9b5e49ea7cddc9ab7c8b43a11a9c76a4dff4a
Author: neha-ha <137219201+neha-ha@users.noreply.github.com >
Date: Tue Nov 18 12:17:00 2025 -0800
Refactored pipelines and workgroup calculations (#10 )
* refactored pipelines
* refactored workgroup calculation
* removed commented out block of prior maps
* Clean up ceiling division pattern
---------
Co-authored-by: Neha Abbas <nehaabbas@eduroam-169-233-141-223.ucsc.edu >
Co-authored-by: Reese Levine <reeselevine1@gmail.com >
Author: James Contini <jamescontini@gmail.com >
Date: Wed Oct 29 23:13:06 2025 -0700
formatted embed wgsl and ggml-webgpu.cpp
commit e1f6baea31645e5d96ad53664acae856f74b96f4
Author: James Contini <jamescontini@gmail.com >
Date: Wed Oct 29 23:08:37 2025 -0700
implemented REPL_Template support and removed bug in unary operators kernel
commit 8c70b8fece445cdc9a8c660dbddbf201e52da2bb
Author: James Contini <jamescontini@gmail.com >
Date: Wed Oct 15 16:14:20 2025 -0700
responded and dealt with PR comments
commit f9282c660c10dec4487d434549bdb707a9cd9f37
Author: James Contini <jamescontini@gmail.com >
Date: Sun Oct 12 13:41:41 2025 -0700
removed unnecesarry checking if node->src[1] exists for unary operators
commit 4cf28d7dec41c29186d66152735b244c5699f9dc
Author: James Contini <jamescontini@gmail.com >
Date: Sun Oct 12 13:32:45 2025 -0700
All operators (inlcluding xielu) working
commit 74c6add1761a59d2c2ff60b60e8ad3c8300f6d3e
Author: James Contini <jamescontini@gmail.com >
Date: Fri Oct 10 13:16:48 2025 -0700
fixed autoconfig
commit 362749910be4f0120c8ffb21ceddeb7d2c088e51
Author: James Contini <jamescontini@gmail.com >
Date: Fri Oct 10 13:10:46 2025 -0700
removed vestigial files
commit cb0858333785757804c5104e59c4981843207c16
Author: James Contini <jamescontini@gmail.com >
Date: Fri Oct 10 12:59:32 2025 -0700
abides by editor-config
commit 5360e2852a4b51197d7d67d0a5d42e908b02d7ed
Author: James Contini <jamescontini@gmail.com >
Date: Fri Oct 10 12:45:57 2025 -0700
rms_norm double declaration bug atoned
commit 7b09baa4aa53711be5a126043670cc182c78bfcd
Merge: 8a6ec843 74b8fc17
Author: James Contini <jamescontini@gmail.com >
Date: Fri Oct 10 11:50:03 2025 -0700
resolving merge conflicts
commit 8a6ec843a50ab82f8cef59b4558eb63f318ba02d
Author: James Contini <jamescontini@gmail.com >
Date: Wed Oct 8 18:06:47 2025 -0700
unary operators pass ggml tests
commit c3ae38278a2db236adc5912c9140e4f0d63f2c19
Author: James Contini <jamescontini@gmail.com >
Date: Wed Oct 1 16:22:40 2025 -0700
neg passes backend test
commit aa1c9b2f8877a405470ca56709c42a1fd43713de
Author: James Contini <jamescontini@gmail.com >
Date: Tue Sep 30 23:55:27 2025 -0700
neg f16xf32xip builds and runs, havent actually ran a model that uses neg kernel yet though
Co-authored-by: James Contini <jamescontini@gmail.com >
Co-authored-by: Neha Abbas <neabbas@ucsc.edu >
Co-authored-by: Abhijit Ramesh <abhijitramesh2k@gmail.com >
* Remove extra code and format
* Add ops documentation (finally)
* Update ggml/src/ggml-webgpu/wgsl-shaders/embed_wgsl.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: James Contini <jamescontini@gmail.com >
Co-authored-by: Neha Abbas <neabbas@ucsc.edu >
Co-authored-by: Abhijit Ramesh <abhijitramesh2k@gmail.com >
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-12-05 12:25:51 -08:00