Piotr Wilkin and Claude Opus 5.5
72da62cea0
upstream-carry #32740 : ggml: compact bias on the existing FLASH_ATTN_EXT for CUDA, ROCm and Vulkan
...
Temporary carry of the open upstream PR
https://github.com/ggml-org/llama.cpp/pull/32740 at head 808fd1c4e,
its four commits (1fa93f902, d29f9d489, ff91e4f84, 808fd1c4e) squashed.
Inkling's per-query bias table is applied inside flash attention
instead of a dense [n_kv, n_tokens, n_head] bias tensor, which cuts
Inkling's compute buffers and long-context prefill time on the RX 580.
Drop this commit when the PR is merged upstream (FORK.md, "Temporary
upstream carries").
One conflict, ggml-vulkan.cpp use_mask_opt: kept the fork's GCN
`HSK >= 256 || HSV >= 256` clause and its comment (F2) and upstream's
`!use_sparse`, added the PR's `!bias &&`.
Original commit trailer: Assisted-by: Codex
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_01PZz44SLQvTXMyWGio6t9DZ
2026-11-22 02:30:27 +01:00
..
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-09 20:52:32 +08:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-11 15:16:16 +02:00
2026-11-08 15:49:06 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-09 20:52:32 +08:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-11 15:16:16 +02:00
2026-11-14 09:49:27 +01:00
2026-11-20 17:19:14 +08:00
2026-11-20 09:51:41 +02:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-14 09:49:27 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-09 20:52:32 +08:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 10:26:55 +02:00
2026-11-21 16:30:01 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 15:41:03 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 12:10:04 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 10:26:55 +02:00
2026-11-21 12:10:38 +01:00
2026-11-22 02:30:27 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-21 10:26:55 +02:00
2026-11-11 15:16:16 +02:00
2026-11-17 22:25:44 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-15 01:05:20 +01:00
2026-11-21 16:30:01 +01:00
2026-11-14 09:49:27 +01:00
2026-11-18 23:09:55 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-09 20:52:32 +08:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 15:41:03 +01:00
2026-11-21 16:30:01 +01:00
2026-11-22 02:30:27 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 14:25:19 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-10 17:42:30 +09:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-15 02:02:15 +08:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-08-04 17:26:15 +02:00
2026-11-19 10:13:02 +01:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-12 15:54:58 +01:00
2026-11-21 16:30:01 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-15 19:36:08 +08:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 21:10:36 +01:00
2026-11-05 15:41:03 +01:00
2026-11-09 20:52:32 +08:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 21:10:36 +01:00
2026-11-18 00:04:15 +01:00
2026-11-05 15:41:03 +01:00
2026-11-05 15:41:03 +01:00
2026-11-09 20:52:32 +08:00
2026-11-05 21:10:36 +01:00
2026-11-21 16:30:01 +01:00
2026-11-15 19:44:44 +01:00