llama.cpp

10,572 Commits 5 Branches 0 Tags

2 Commits

Include renames

Author	SHA1	Message	Date
Hongqiang Wang	3af988fabc	opencl: fold the gpt-oss MoE per-expert bias adds into the epilogue (op/kernel fusion) (#26431 ) * opencl: fold the gpt-oss MoE bias adds into swiglu_oai Default on, opt out with GGML_OPENCL_FUSE_MOE_BIAS_GLU=0. * opencl: fold the MoE down-projection bias into the combine Default on, opt out with GGML_OPENCL_FUSE_MOE_BIAS_COMBINE=0.	2026-08-21 14:24:33 -07:00
Hongqiang WangandLi He	1d1d9a9ed7	opencl: add int8 dp4 dense and MoE prefill optimization for Adreno GPUs (#25537 ) * opencl: add int8 dp4 dense and moe GEMM * opencl: refactor --------- Co-authored-by: Li He <lih@qti.qualcomm.com>	2026-07-10 23:05:58 -07:00

Author

SHA1

Message

Date

Hongqiang Wang

3af988fabc

opencl: fold the gpt-oss MoE per-expert bias adds into the epilogue (op/kernel fusion) (#26431 )

* opencl: fold the gpt-oss MoE bias adds into swiglu_oai

Default on, opt out with GGML_OPENCL_FUSE_MOE_BIAS_GLU=0.

* opencl: fold the MoE down-projection bias into the combine

Default on, opt out with GGML_OPENCL_FUSE_MOE_BIAS_COMBINE=0.

2026-08-21 14:24:33 -07:00

Hongqiang WangandLi He

1d1d9a9ed7

opencl: add int8 dp4 dense and MoE prefill optimization for Adreno GPUs (#25537 )

* opencl: add int8 dp4 dense and moe GEMM

* opencl: refactor

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>

2026-07-10 23:05:58 -07:00