Aman GuptaandAman Gupta <aman> c8a2417d7b CUDA: experimental native mxfp4 support for blackwell (#17906) ...

* CUDA: experimental native mxfp4 support for blackwell

* optimize load_tiles

* optimize quantize_mxfp4

* cleanup

* first pass review: formatting

* use interleaved layout for mma

* mmq: add assert for size

* use __nv_fp4x4_e2m1

* use iter_k as 512, cleanup

* Use 1200 as blackwell instead of 1000

* address review comments

* mmq: fix stride

* quantize.cu: use reference impl of e8m0 scale

* address review comments

* add 120f-virtual + minor fixes

---------

Co-authored-by: Aman Gupta <aman>

2025-12-24 22:28:26 +08:00

..

ggml-blas

sync : whisper.cpp (ggml/1359)

2025-09-29 17:43:58 +03:00

ggml-cann

CANN : refactor ACL graph cache (#17752)

2025-12-24 17:50:24 +08:00

ggml-cpu

llamafile: add rvv support for sgemm kernels (#18199)

2025-12-22 20:20:23 +02:00

ggml-cuda

CUDA: experimental native mxfp4 support for blackwell (#17906)

2025-12-24 22:28:26 +08:00

ggml-hexagon

ggml-hexagon: create generalized functions for cpu side op (#17500)

2025-12-22 23:13:24 -08:00

ggml-hip

HIP: fix AMDGPU_TARGETS, update documentation (#16803)

2025-10-27 21:39:49 +01:00

ggml-metal

metal: use shared buffers on eGPU (#17866)

2025-12-15 16:14:49 +02:00

ggml-musa

CUDA: faster tile FA, add oob checks, more HSs (#16492)

2025-10-11 20:54:32 +02:00

ggml-opencl

opencl: unpack q4_0 for adreno in get_tensor (#18278)

2025-12-22 10:19:01 -08:00

ggml-rpc

rpc : add check for rpc buffer type (#18242)

2025-12-23 11:56:49 +02:00

ggml-sycl

[SYCL] Support gpt-oss by OPs add-id, mul_mat for mxfp4, swiglu_oai (#17826)

2025-12-15 10:35:15 +08:00

ggml-vulkan

vulkan: fix command buffer corruption in ggml_backend_vk_event_wait (#18302)

2025-12-24 12:36:34 +01:00

ggml-webgpu

ggml webgpu: unary op suppport, code refactoring, ops support (#17764)

2025-12-05 12:25:51 -08:00

ggml-zdnn

zdnn: refactor codebase + add docs (#16178)

2025-09-23 14:53:05 +08:00

ggml-zendnn

ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690)

2025-12-07 00:13:33 +08:00

CMakeLists.txt

llama.android : Rewrite Android binding (w/o cpu_features dep) (#17413)

2025-12-17 10:14:47 +02:00

ggml-alloc.c

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00

ggml-backend-impl.h

rpc : add support for multiple devices (#16276)

2025-10-04 12:49:16 +03:00

ggml-backend-reg.cpp

ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690)

2025-12-07 00:13:33 +08:00

ggml-backend.cpp

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00

ggml-common.h

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

ggml-impl.h

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

2025-11-13 20:54:47 +02:00

ggml-opt.cpp

finetune: SGD optimizer, more CLI args (#13873)

2025-08-14 12:03:57 +02:00

ggml-quants.c

ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (#15928)

2025-09-23 10:25:20 +02:00

ggml-quants.h

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

ggml, llama : use defaulted constructors/destructors (#17649)

2025-12-03 07:12:18 +01:00