llama.cpp

2,718 Commits 4 Branches 0 Tags

1 Commits

Author	SHA1	Message	Date
jiezandz5269887	91c736015b	llama : add gguf_remove_key + remove split meta during quantize (#6591 ) * Remove split metadata when quantize model shards * Find metadata key by enum * Correct loop range for gguf_remove_key and code format * Free kv memory --------- Co-authored-by: z5269887 <z5269887@unsw.edu.au>	2024-04-12 13:45:06 +03:00

Author

SHA1

Message

Date

jiezandz5269887

91c736015b

llama : add gguf_remove_key + remove split meta during quantize (#6591 )

* Remove split metadata when quantize model shards

* Find metadata key by enum

* Correct loop range for gguf_remove_key and code format

* Free kv memory

---------

Co-authored-by: z5269887 <z5269887@unsw.edu.au>

2024-04-12 13:45:06 +03:00