CUDA: refactor MMQ kernel configuration (#24127)

Browse Source

* CUDA: refactor MMQ kernel configuration

* fix Blackwell config

* remove legacy code

...

This commit is contained in:

Johannes Gäßler

2026-07-13 18:37:57 +02:00

committed by GitHub

parent e920c523e3

commit 6eddde06a4

10 changed files with 5121 additions and 3540 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-cuda/mmq-vec-dot.cuh

+1251

File diff suppressed because it is too large Load Diff