xctanandGeorgi Gerganov f470bc36be ggml-cpu : split arch-specific implementations (#13892) ...

* move ggml-cpu-aarch64 to repack

* split quantize_row_q8_0/1

* split helper functions

* split ggml_vec_dot_q4_0_q8_0

* split ggml_vec_dot_q4_1_q8_1

* split ggml_vec_dot_q5_0_q8_0

* split ggml_vec_dot_q5_1_q8_1

* split ggml_vec_dot_q8_0_q8_0

* split ggml_vec_dot_tq1_0_q8_K

* split ggml_vec_dot_tq2_0_q8_K

* split ggml_vec_dot_q2_K_q8_K

* split ggml_vec_dot_q3_K_q8_K

* split ggml_vec_dot_q4_K_q8_K

* split ggml_vec_dot_q5_K_q8_K

* split ggml_vec_dot_q6_K_q8_K

* split ggml_vec_dot_iq2_xxs_q8_K

* split ggml_vec_dot_iq2_xs_q8_K

* split ggml_vec_dot_iq2_s_q8_K

* split ggml_vec_dot_iq3_xxs_q8_K

* split ggml_vec_dot_iq3_s_q8_K

* split ggml_vec_dot_iq1_s_q8_K

* split ggml_vec_dot_iq1_m_q8_K

* split ggml_vec_dot_iq4_nl_q8_0

* split ggml_vec_dot_iq4_xs_q8_K

* fix typos

* fix missing prototypes

* rename ggml-cpu-quants.c

* rename ggml-cpu-traits

* rename arm folder

* move cpu-feats-x86.cpp

* rename ggml-cpu-hbm

* update arm detection macro in quants.c

* move iq quant tables

* split ggml_quantize_mat_q8_0/K

* split ggml_gemv_*

* split ggml_gemm_*

* rename namespace aarch64 to repack

* use weak aliases to replace test macros

* rename GGML_CPU_AARCH64 to GGML_CPU_REPACK

* rename more aarch64 to repack

* clean up rebase leftover

* fix compilation errors

* remove trailing spaces

* try to fix clang compilation errors

* try to fix clang compilation errors again

* try to fix clang compilation errors, 3rd attempt

* try to fix clang compilation errors, 4th attempt

* try to fix clang compilation errors, 5th attempt

* try to fix clang compilation errors, 6th attempt

* try to fix clang compilation errors, 7th attempt

* try to fix clang compilation errors, 8th attempt

* try to fix clang compilation errors, 9th attempt

* more cleanup

* fix compilation errors

* fix apple targets

* fix a typo in arm version of ggml_vec_dot_q4_K_q8_K

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2025-06-09 16:47:13 +02:00

..

dpct

SYCL: Rename oneMKL to oneMath (#12192)

2025-04-01 16:24:29 +08:00

backend.hpp

sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858)

2025-05-09 16:34:08 +01:00

binbcast.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

binbcast.hpp

SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975)

2025-04-18 15:57:56 +02:00

CMakeLists.txt

cmake : Fix broken CMake error messages (ggml/1252)

2025-06-01 13:43:57 +03:00

common.cpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

common.hpp

ggml-cpu : split arch-specific implementations (#13892)

2025-06-09 16:47:13 +02:00

concat.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

concat.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

conv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

conv.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

convert.cpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

convert.hpp

sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343)

2025-05-08 10:08:01 +01:00

cpy.cpp

SYCL: Implement few same quantized type copy kernels (#13739)

2025-06-07 18:58:20 +05:30

cpy.hpp

SYCL: Move CPY kernels to a separate file and add few missing kernels (#12133)

2025-03-03 11:07:22 +01:00

dequantize.hpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

dmmv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

dmmv.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

element_wise.cpp

SYCL: add gelu_erf kernel (#13749)

2025-05-27 20:52:59 +05:30

element_wise.hpp

SYCL: add gelu_erf kernel (#13749)

2025-05-27 20:52:59 +05:30

gemm.hpp

sycl: use oneDNN for matrices multiplication (#12972)

2025-05-15 16:53:41 +02:00

getrows.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

getrows.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

ggml-sycl.cpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

gla.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

gla.hpp

SYCL: Add gated linear attention kernel (#11175)

2025-01-15 11:20:17 +08:00

im2col.cpp

SYCL: Fix im2col (#12910)

2025-04-14 14:23:53 +02:00

im2col.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

mmq.cpp

fixed compilation warnings in ggml-sycl (#12424)

2025-03-18 08:51:25 +08:00

mmq.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

mmvq.cpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

mmvq.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

norm.cpp

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

2025-05-26 21:10:36 +05:30

norm.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

outprod.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

outprod.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

presets.hpp

Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133)

2024-11-07 15:19:10 +08:00

quants.hpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

rope.cpp

SYCL: Add mrope kernel (#13755)

2025-05-30 19:40:57 +05:30

rope.hpp

SYCL: Add non-contiguous support in ROPE (#12993)

2025-04-21 19:13:30 +05:30

softmax.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

softmax.hpp

SYCL : SOFTMAX F16 mask support and other fixes (#11261)

2025-01-28 09:56:58 +00:00

sycl_hw.cpp

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

sycl_hw.hpp

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

tsembd.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

tsembd.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

vecdotq.hpp

sycl: Add reorder to Q6_K mmvq implementation (#13885)

2025-06-09 11:47:07 +02:00

wkv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

wkv.hpp

llama: Add support for RWKV v7 architecture (#12412)

2025-03-18 07:27:50 +08:00