Lumpiasty
175eb7ac30
llama: free backend compute scratch on cold; guard memory_breakdown
...
On device release with KV eviction, also call ggml_backend_free_scratch()
on each backend so a cold model drops its Vulkan compute preallocations
(reallocated lazily on the next compute via restore).
Also guard llama_context::memory_breakdown() against a freed scheduler:
evict_kv release resets sched to null, so a cold model that is then torn
down (e.g. terminated by the process manager) hit GGML_ASSERT(sched) in
ggml_backend_sched_get_buffer_type. Skip the compute-buffer accounting
when sched is null.
Assisted-by: Claude
2026-10-09 00:32:05 +02:00
..
2026-10-08 17:42:28 +02:00
2026-10-07 21:07:45 +03:00
2026-09-17 09:19:44 +02:00
2026-03-18 12:03:26 +02:00
2026-10-08 09:29:20 +03:00
2026-10-08 09:29:20 +03:00
2026-10-05 01:35:49 +02:00
2026-10-05 01:35:49 +02:00
2026-05-28 13:13:33 +02:00
2026-05-28 13:13:33 +02:00
2026-10-09 00:32:05 +02:00
2026-10-09 00:31:17 +02:00
2025-06-15 10:08:58 +03:00
2026-10-07 21:07:45 +03:00
2026-10-03 02:50:48 +02:00
2026-09-24 21:43:26 +03:00
2026-01-03 16:02:43 -06:00
2026-10-08 15:50:49 +05:30
2026-10-07 21:07:45 +03:00
2026-09-24 16:25:07 +02:00
2026-10-08 09:29:20 +03:00
2026-09-30 20:27:18 +08:00
2026-09-30 20:27:18 +08:00
2026-05-02 18:03:25 +03:00
2026-09-26 10:23:03 +03:00
2026-08-21 19:52:34 +02:00
2026-08-21 19:52:34 +02:00
2026-09-26 10:23:03 +03:00
2026-08-03 14:56:30 +02:00
2026-10-05 01:35:49 +02:00
2026-08-02 20:55:34 +08:00
2026-10-09 00:31:17 +02:00
2026-10-09 00:31:17 +02:00
2026-08-03 16:30:08 +03:00
2026-08-03 16:30:08 +03:00
2026-10-09 00:31:17 +02:00
2026-10-09 00:31:17 +02:00
2026-09-30 14:20:32 +08:00
2026-10-06 18:31:13 +02:00
2026-10-06 18:31:13 +02:00
2026-07-08 15:55:19 +08:00
2026-05-16 20:06:23 +08:00
2026-10-09 00:31:39 +02:00
2026-10-09 00:31:17 +02:00
2026-10-09 00:31:39 +02:00
2026-10-09 00:31:39 +02:00
2025-06-30 18:03:03 +03:00
2026-10-09 00:31:17 +02:00
2026-10-01 09:44:31 +02:00
2026-10-01 09:44:31 +02:00
2026-10-01 09:44:31 +02:00
2026-08-30 16:59:48 +02:00
2026-10-06 18:42:24 +02:00
2026-08-27 21:32:31 +02:00
2026-10-09 00:31:17 +02:00
2026-10-09 00:31:07 +02:00
2026-10-08 15:50:49 +05:30
2026-10-08 15:50:49 +05:30
2026-09-30 14:20:32 +08:00
2025-01-03 10:18:53 +02:00
2026-10-07 13:34:18 +03:00
2026-08-10 16:58:56 +03:00
2026-09-03 23:53:04 +02:00
2026-10-07 11:40:35 +02:00
2026-10-06 18:42:24 +02:00
2026-10-02 10:44:44 +02:00
2024-10-08 13:27:04 +02:00
2024-10-02 15:49:55 +02:00
2026-10-06 18:42:24 +02:00
2026-04-03 10:33:03 +02:00