Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

opencl: add opt-in Adreno xmem F16xF32 GEMM for prefill (#22755)

Browse Source 
* ggml-opencl: add Adreno xmem F16xF32 GEMM for prefill

* ggml-opencl: address Adreno xmem review comments

* ggml-opencl: align xmem gemm kernel naming

---------

Co-authored-by: Your Name <your@email.com>
This commit is contained in:
yzyyzyhhh
2026-05-12 13:10:37 -07:00
committed by GitHub
co-authored by Your Name
parent cce09f0b2b
commit a9883db8ee
3 changed files with 457 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
ggml/src/ggml-opencl/CMakeLists.txt
+4
View File
@@ -176,6 +176,10 @@ set(GGML_OPENCL_KERNELS
flash_attn_f32
)
if (GGML_OPENCL_USE_ADRENO_KERNELS)
list(APPEND GGML_OPENCL_KERNELS gemm_xmem_f16_f32_os8)
endif ()
foreach (K ${GGML_OPENCL_KERNELS})
ggml_opencl_add_kernel(${K})
endforeach()