hexagon: add HTP kernel for GGML_OP_GATED_DELTA_NET (#22837)

Implement the Gated Delta Net recurrence on HVX with:
- 4-row fused kernels for PP (prompt processing) path
- 8-row fused kernels for TG (token generation) path, reducing
  K/Q/gate vector reload overhead by 2x
- Separate PP/TG thread functions for I-cache isolation
- VTCM state scratchpad with DMA in/out for TG single-cycle access
- Vectorized gate exp via hvx_exp_f32
This commit is contained in:
Yanzhao Wang
2026-05-08 17:12:04 -07:00
committed by GitHub
parent c5703e03a5
commit 66001722aa
6 changed files with 1045 additions and 27 deletions
+1
View File
@@ -84,6 +84,7 @@ enum htp_op_code {
HTP_OP_DIAG,
HTP_OP_SOLVE_TRI,
HTP_OP_L2_NORM,
HTP_OP_GATED_DELTA_NET,
HTP_OP_INVALID
};