Aman Gupta
4c4a0f0a42
llama : reserve graph nodes for the MoE cache ( #32636 )
...
The MoE cache adds a slot lookup to every MoE layer, and with
--moe-cache-cpu-share a second expert path, but graph_max_nodes() did
not account for it. Models on the default 8*n_tensors budget with few
tensors per layer (cohere2moe: 443 tensors, 49 layers) overflow the
graph context when the cache is combined with a quantized KV cache
(K/V rotation), aborting in ggml_new_tensor with GGML_ASSERT(obj_new).
Fixes #32584
Assisted-by: Claude Opus 5.5
2026-11-20 16:13:00 +08:00
..
2026-11-20 09:51:41 +02:00
2026-11-07 08:43:50 +02:00
2026-10-22 08:12:17 +03:00
2026-03-18 12:03:26 +02:00
2026-11-20 09:51:41 +02:00
2026-11-20 09:51:41 +02:00
2026-11-18 20:15:43 +01:00
2026-11-18 20:15:43 +01:00
2026-05-28 13:13:33 +02:00
2026-05-28 13:13:33 +02:00
2026-11-20 16:13:00 +08:00
2026-11-16 15:16:12 +01:00
2025-06-15 10:08:58 +03:00
2026-11-18 17:04:40 +05:30
2026-11-19 08:08:12 +09:00
2026-11-16 19:48:24 +01:00
2026-11-13 13:52:21 +02:00
2026-11-19 14:36:30 +01:00
2026-11-19 14:36:30 +01:00
2026-11-18 15:46:49 +01:00
2026-11-18 15:46:49 +01:00
2026-10-21 12:03:27 +03:00
2026-10-21 12:03:27 +03:00
2026-05-02 18:03:25 +03:00
2026-09-26 10:23:03 +03:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-05 21:10:36 +01:00
2026-10-27 07:53:44 +02:00
2026-11-18 20:15:43 +01:00
2026-11-03 08:08:42 +02:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-16 10:52:09 +01:00
2026-11-15 00:51:31 +01:00
2026-11-16 10:52:09 +01:00
2026-11-17 22:37:25 +08:00
2026-11-17 22:37:25 +08:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-14 23:57:23 +01:00
2026-10-30 10:11:58 +02:00
2026-11-19 08:08:12 +09:00
2026-10-26 16:21:25 +02:00
2026-11-19 08:57:57 +01:00
2026-11-19 08:57:57 +01:00
2026-11-19 08:57:57 +01:00
2026-10-13 17:28:15 +03:00
2026-11-18 15:46:49 +01:00
2026-10-26 12:16:02 +02:00
2026-11-20 09:51:41 +02:00
2026-11-18 15:46:49 +01:00
2026-11-14 22:14:48 +08:00
2026-11-13 18:48:29 +08:00
2026-11-19 08:57:57 +01:00
2025-01-03 10:18:53 +02:00
2026-11-12 20:59:09 +02:00
2026-08-10 16:58:56 +03:00
2026-09-03 23:53:04 +02:00
2026-11-20 09:51:41 +02:00
2026-11-15 19:44:44 +01:00
2026-11-12 20:59:09 +02:00
2026-10-14 08:33:24 +03:00
2026-10-14 08:33:24 +03:00
2026-11-18 11:44:28 +01:00
2026-10-21 12:03:27 +03:00