Lumpiasty
b7cb284e54
llama: free backend compute scratch on cold; guard memory_breakdown
...
On device release with KV eviction, also call ggml_backend_free_scratch()
on each backend so a cold model drops its Vulkan compute preallocations
(reallocated lazily on the next compute via restore).
Also guard llama_context::memory_breakdown() against a freed scheduler:
evict_kv release resets sched to null, so a cold model that is then torn
down (e.g. terminated by the process manager) hit GGML_ASSERT(sched) in
ggml_backend_sched_get_buffer_type. Skip the compute-buffer accounting
when sched is null.
Assisted-by: Claude
2026-11-21 19:39:51 +01:00
..
2026-11-21 16:30:01 +01:00
2026-11-07 08:43:50 +02:00
2026-10-22 08:12:17 +03:00
2026-03-18 12:03:26 +02:00
2026-11-21 14:25:19 +01:00
2026-11-21 14:25:19 +01:00
2026-11-18 20:15:43 +01:00
2026-11-18 20:15:43 +01:00
2026-05-28 13:13:33 +02:00
2026-05-28 13:13:33 +02:00
2026-11-21 19:39:51 +01:00
2026-11-21 19:39:46 +01:00
2025-06-15 10:08:58 +03:00
2026-11-21 10:26:55 +02:00
2026-11-19 08:08:12 +09:00
2026-11-21 07:00:30 +01:00
2026-11-13 13:52:21 +02:00
2026-11-21 16:30:01 +01:00
2026-11-21 16:30:01 +01:00
2026-11-18 15:46:49 +01:00
2026-11-18 15:46:49 +01:00
2026-10-21 12:03:27 +03:00
2026-10-21 12:03:27 +03:00
2026-05-02 18:03:25 +03:00
2026-09-26 10:23:03 +03:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-05 21:10:36 +01:00
2026-10-27 07:53:44 +02:00
2026-11-18 20:15:43 +01:00
2026-11-03 08:08:42 +02:00
2026-11-21 19:39:46 +01:00
2026-11-21 19:39:46 +01:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-21 19:39:46 +01:00
2026-11-21 19:39:46 +01:00
2026-11-16 10:52:09 +01:00
2026-11-21 13:22:36 +08:00
2026-11-17 22:37:25 +08:00
2026-10-27 07:53:44 +02:00
2026-10-27 07:53:44 +02:00
2026-11-21 19:39:51 +01:00
2026-11-21 19:39:46 +01:00
2026-11-21 19:39:51 +01:00
2026-11-21 19:39:51 +01:00
2026-11-21 19:39:46 +01:00
2026-11-21 19:39:46 +01:00
2026-11-19 08:57:57 +01:00
2026-11-19 08:57:57 +01:00
2026-11-19 08:57:57 +01:00
2026-10-13 17:28:15 +03:00
2026-11-18 15:46:49 +01:00
2026-10-26 12:16:02 +02:00
2026-11-21 19:39:46 +01:00
2026-11-21 19:32:30 +01:00
2026-11-14 22:14:48 +08:00
2026-11-13 18:48:29 +08:00
2026-11-20 23:01:07 +01:00
2025-01-03 10:18:53 +02:00
2026-11-12 20:59:09 +02:00
2026-08-10 16:58:56 +03:00
2026-09-03 23:53:04 +02:00
2026-11-20 09:51:41 +02:00
2026-11-15 19:44:44 +01:00
2026-11-12 20:59:09 +02:00
2026-10-14 08:33:24 +03:00
2026-10-14 08:33:24 +03:00
2026-11-18 11:44:28 +01:00
2026-10-21 12:03:27 +03:00