ggml-webgpu: updated matrix-vector multiplication (#21738)

Browse Source

* merged properly, but slow q3_k and q5_k with u32 indexing

* Start on new mat-vec

* New format float paths working

* Working q4_0

* Work on remaining legacy q-types

* port k-quants to new matvec

* remove old shader

* Remove old constants, format

* remove accidental file

---------

Co-authored-by: Neha Abbas <nehaabbas@ReeseLevines-MacBook-Pro.local>
Co-authored-by: Reese Levine <reeselevine1@gmail.com>

...

This commit is contained in:

neha-ha

2026-04-20 07:37:17 -07:00

committed by GitHub

co-authored by Neha Abbas Reese Levine

parent a678916623

commit a6cc43c286

4 changed files with 816 additions and 411 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec.wgsl

+779 -379

File diff suppressed because it is too large Load Diff