CUDA: generalized (mma) FA, add Volta support (#17505)

Browse Source

* CUDA: generalized (mma) FA, add Volta support

* use struct for MMA FA kernel config

---------

Co-authored-by: Aman Gupta <aman>

...

This commit is contained in:

Johannes Gäßler

2025-12-03 16:57:05 +01:00

committed by GitHub

co-authored by Aman Gupta <aman>

parent 190c4838bd

commit 2e1c9cd814

10 changed files with 966 additions and 759 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-cuda/fattn-mma-f16.cuh

+673 -603

File diff suppressed because it is too large Load Diff