Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
4d0598e1445a64c99cf2faac72f8d5d023f1e6a1
llama.cpp/ggml/src/ggml-cuda/vendors
T
History
Johannes GäßlerandDiego Devesa 864a0b67a6 CUDA: use mma PTX instructions for FlashAttention (#11583) 
* CUDA: use mma PTX instructions for FlashAttention

* __shfl_sync workaround for movmatrix

* add __shfl_sync to HIP

Co-authored-by: Diego Devesa <slarengh@gmail.com>
2025-02-02 19:31:09 +01:00
..
cuda.h
CUDA: add BF16 support (#11093)
2025-01-06 02:33:52 +01:00
hip.h
CUDA: use mma PTX instructions for FlashAttention (#11583)
2025-02-02 19:31:09 +01:00
musa.h
CUDA: add BF16 support (#11093)
2025-01-06 02:33:52 +01:00