Alexander HeislerandOliver Simons d9b6be07d0 ggml-cuda: provide static workspace for cuBLAS handles (#26574) ...

* provide static workspace for cuBLAS handles

* account for concurrent streams when using GGML_CUDA_GRAPH_OPT

* drop cublas_handle overloads and remove direct cublasSetStream calls

* Update ggml/src/ggml-cuda/common.cuh

---------

Co-authored-by: Oliver Simons <osimons@nvidia.com>

2026-08-20 10:27:51 +03:00

..

ggml-blas

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-cann

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml-cpu

ggml-cpu: gate __fp16 on __ARM_FP16_FORMAT_IEEE (#26860)

2026-08-19 22:03:13 +02:00

ggml-cuda

ggml-cuda: provide static workspace for cuBLAS handles (#26574)

2026-08-20 10:27:51 +03:00

ggml-et

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml-hexagon

hexagon: fix FA HMX queue ordering and pack the rescale D matrices (#27042)

2026-08-19 14:42:57 -07:00

ggml-hip

ggml-hip : remove -funsafe-math-optimizations (#26696)

2026-08-13 08:38:02 +02:00

ggml-metal

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml-musa

ggml-cuda: native bf16 flash attention for vec kernel (#20525)

2026-03-22 11:05:51 +01:00

ggml-opencl

opencl: make the MoE expert scatter deterministic (#26464)

2026-08-19 20:40:19 -07:00

ggml-openvino

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml-rpc

RPC: populate use_count to enable fusion inside backends (#27142)

2026-08-18 21:08:57 +05:30

ggml-sycl

sycl: report zero devices instead of aborting when the host has none (#27291)

2026-08-19 07:46:01 -07:00

ggml-virtgpu

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-vulkan

vulkan : add source groups for shaders (#26666)

2026-08-20 09:52:28 +03:00

ggml-webgpu

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml-zdnn

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-zendnn

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

CMakeLists.txt

ggml: enable PowerPC backend variants on AIX (#25983)

2026-07-22 17:26:40 +08:00

ggml-alloc.c

ggml-alloc: fix out-of-bounds read in ggml_dyn_tallocr_remove_block (ggml/1492)

2026-05-25 12:38:01 +03:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

tensor-split meta backend fixes (#26502)

2026-08-19 14:53:27 -07:00

ggml-backend-meta.cpp

tensor-split meta backend fixes (#26502)

2026-08-19 14:53:27 -07:00

ggml-backend-reg.cpp

ggml-et: Initial ET backend (#24179)

2026-07-10 12:38:34 +08:00

ggml-backend.cpp

tensor-split meta backend fixes (#26502)

2026-08-19 14:53:27 -07:00

ggml-common.h

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-feats.h

ggml : fix arm builds, unused var (#26991)

2026-08-13 07:57:24 +03:00

ggml-impl.h

ggml: add graph_reused (#21764)

2026-04-16 17:21:28 +08:00

ggml-opt.cpp

fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)

2026-04-08 17:40:15 +02:00

ggml-quants.c

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-quants.h

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

2026-08-19 14:04:57 +02:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

gguf : harden loader against malformed tensor dims and metadata types (#25596)

2026-08-12 15:07:48 +03:00