Georgi GerganovandGitHub 47068e5170 speculative : PoC for speeding-up inference via speculative sampling (#2926) ...

* speculative : initial example

* speculative : print encoding speed

* speculative : add --draft CLI arg

2023-09-03 15:12:08 +03:00

..

CMakeLists.txt

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

common.cpp

speculative : PoC for speeding-up inference via speculative sampling (#2926)

2023-09-03 15:12:08 +03:00

common.h

speculative : PoC for speeding-up inference via speculative sampling (#2926)

2023-09-03 15:12:08 +03:00

console.cpp

build : fix most gcc and clang warnings (#2861)

2023-09-01 16:34:50 +03:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

grammar-parser.cpp

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

grammar-parser.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

log.h

logging: Fix creating empty file even when disabled (#2966)

2023-09-02 11:53:55 -06:00