Johannes Gäßler
|
e495d1e748
|
CUDA: fix Gemma E4B MTP FlashAttention (#25148)
* CUDA: fix Gemma E4B MTP FlashAttention
* remove unused template declaration
|
2026-06-30 14:06:54 +02:00 |
|
Johannes Gäßler
|
0cf6725e9f
|
CUDA: FA support for Deepseek (Ampere or newer) (#13306)
* CUDA: FA support for Deepseek (Ampere or newer)
* do loop unrolling via C++ template
|
2025-05-09 13:34:58 +02:00 |
|
Johannes Gäßler
|
5fa07c2f93
|
CUDA: optimize FA for GQA + large batches (#12014)
|
2025-02-22 12:20:17 +01:00 |
|