metal : add Q2_0 support (#25419) · 14d3ba45f3 - llama.cpp - Gitea: Git with a cup of tea

Lumpiasty/llama.cpp

metal : add Q2_0 support (#25419)

This commit is contained in:

Pasha Khosravi

2026-07-14 07:52:00 +03:00

committed by

GitHub

parent 2969d6d15d

commit 14d3ba45f3

5 changed files with 213 additions and 0 deletions

									
										ggml/src/ggml-metal/ggml-metal-impl.h
									
		+3
		
												View File
												
				@@ -24,6 +24,9 @@

				#define N_R0_Q1_0 8

				#define N_SG_Q1_0 2

				#define N_R0_Q2_0 8

				#define N_SG_Q2_0 2

				#define N_R0_Q4_0 4

				#define N_SG_Q4_0 2