Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,394 Commits 5 Branches 0 Tags
680a9ae63d60d35c21a0dcd7d3fabdb9c6bfc963
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Rafail Giavrimis ebb546b7e9 CUDA: only disable CUDA graphs when mul_mat_id actually needs a stream sync (#26802) 2026-08-11 20:50:03 +03:00
Rafail Giavrimis 687e778927 CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767) 
* CUDA: fuse rms_norm + mul + rope (+ view + set_rows)

* tests: add broadcast weight case to rms_norm_mul_rope

* CUDA: check memory ranges before rms_norm rope fusion

* CUDA: check memory ranges in rope set_rows fusion
 2026-08-09 00:32:37 +08:00
Rafail Giavrimis 69bf643791 CUDA: fix thread/block count in quantized cpy kernel launches (#26731) 
* CUDA: fix thread/block count in quantized cpy kernel launches

* tests: add uneven block count cpy case
 2026-08-08 07:40:04 +03:00