4 Commits

Include renames

Author	SHA1	Message	Date
Anav PrasadandJohannes Gäßler	88458164c7	CUDA: Add Flash Attention Support for Head Dimension 512 (#20998) ... * flash attention support for head dimension 512 added * FA D=512 - match 576 configs, limit ncols2, revert vec cap * fix HIP tile kernel build for D=512 * fix HIP tile kernel occupancy for D=512 on AMD * Apply suggestions from code review Co-authored-by: Johannes Gäßler <johannesg@5d6.de> * fix tile FA compilation --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de>	2026-04-01 09:07:24 +02:00
Aman Gupta	b70d251076	CUDA: add gqa_ratio 4 for GLM 4.7 flash (#18953)	2026-01-22 18:51:53 +08:00
Johannes Gäßler	0cf6725e9f	CUDA: FA support for Deepseek (Ampere or newer) (#13306) ... * CUDA: FA support for Deepseek (Ampere or newer) * do loop unrolling via C++ template	2025-05-09 13:34:58 +02:00
Johannes Gäßler	5fa07c2f93	CUDA: optimize FA for GQA + large batches (#12014)	2025-02-22 12:20:17 +01:00