 uvosandJohannes Gäßler
|
0142961a2e
|
CUDA/HIP: optimize mmv paths taken for HIP devices (#14324)
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
|
2025-06-24 01:12:56 +02:00 |
|
|
Johannes Gäßler
|
defe2158dd
|
CUDA: mul_mat_v support for batch sizes > 1 (#14262)
* CUDA: mul_mat_v support for batch sizes > 1
* use 64 bit math for initial offset calculation
|
2025-06-23 13:11:31 +02:00 |
|
|
Johannes Gäßler
|
658987cfc9
|
CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID (#13014)
* CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID
* fix logic for RoPE support, CUDA graphs
|
2025-04-22 21:27:40 +02:00 |
|
|
R0CKSTAR
|
492d7f1ff7
|
musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (#12611)
* musa: fix all warnings
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
* musa: enable -DLLAMA_FATAL_WARNINGS=ON in run.sh
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
* musa: update ci doc (install ccache)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
* fix Windows build issue
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2025-03-30 10:59:38 +02:00 |
|
|
Johannes Gäßler
|
fa62da9b2d
|
CUDA: support for mat. mul. with ne03 != ne13 (#11656)
|
2025-02-05 08:58:31 +01:00 |
|
|
uvos
|
396856b400
|
CUDA/HIP: add support for selectable warp size to mmv (#11519)
CUDA/HIP: add support for selectable warp size to mmv
|
2025-02-02 22:40:09 +01:00 |
|
|
Johannes Gäßler
|
46e3556e01
|
CUDA: add BF16 support (#11093)
* CUDA: add BF16 support
|
2025-01-06 02:33:52 +01:00 |
|
|
Johannes Gäßler
|
26a8406ba9
|
CUDA: fix shared memory access condition for mmv (#10740)
|
2024-12-09 20:07:12 +01:00 |
|
|
Johannes Gäßler
|
c3ea58aca4
|
CUDA: remove DMMV, consolidate F16 mult mat vec (#10318)
|
2024-11-17 09:09:55 +01:00 |
|