opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303)

Browse Source

* opencl: add q4_k moe support

* opencl: add q5_k moe support

* opencl: add q6_k moe support

* opencl: adjust format

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>

...

This commit is contained in:

shaofeiqi

2026-05-19 14:29:00 -07:00

committed by GitHub

co-authored by Li He

parent 17d22a35b2

commit b28a2f372a

9 changed files with 2600 additions and 7 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-opencl/ggml-opencl.cpp

+939 -7

File diff suppressed because it is too large Load Diff