Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,846 Commits 4 Branches 0 Tags
aaa40999251f5d18309b3fddc5a7d576f5fdb4e1
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zhenwei JinandGeorgi Gerganov 6102037bbb vocab : refactor tokenizer to reduce init overhead (#9449) 
* refactor tokenizer

* llama : make llm_tokenizer more private

ggml-ci

* refactor tokenizer

* refactor tokenizer

* llama : make llm_tokenizer more private

ggml-ci

* remove unused files

* remove unused fileds to avoid unused filed build error

* avoid symbol link error

* Update src/llama.cpp

* Update src/llama.cpp

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-09-28 15:10:58 +03:00
Zhenwei Jin f1485161e5 src: make tail invalid when kv cell is intersection for mamba (#9249) 2024-09-02 13:53:23 -04:00
Zhenwei Jin 4af8420afb common : remove duplicate function llama_should_add_bos_token (#8778) 2024-08-15 10:23:23 +03:00
Zhenwei Jinandslaren 506122d854 llama-bench : add support for getting cpu info on Windows (#8824) 
* Add support for getting cpu info on Windows for llama_bench

* refactor

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-08-07 03:01:06 +02:00