Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
632 Commits 5 Branches 0 Tags
35a84916fb029905c44746127026079268216e7a
Commit Graph
19 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuval PeledandGeorgi Gerganov f4c55d3bd7 docs : add performance troubleshoot + example benchmark documentation (#1674) 
* test anchor link

* test table

* add benchmarks

* Add performance troubleshoot & benchmark

* add benchmarks

* remove unneeded line

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-06-05 23:32:36 +03:00
Foul-Tarnished f1465624c2 readme : fix typo (#1700) 
Fix a typo in a command in README.md
 2023-06-05 23:28:37 +03:00
Erik Scholz 5ea4339273 make kv_f16 the default for api users (#1517) 2023-05-18 19:31:01 +02:00
Erik Scholz a3b85b28da ci : add cublas to windows release (#1271) 2023-05-05 22:56:09 +02:00
jon-chuangDannyDaemonicjon-chuang
 		a5d30b1f53 common : better default number of threads (#934) 
* commit

* fix

* try-catch

* apply code review

* improve

* improve

* add macos headers

* done

* remove color

* fix windows

* minor

* fix

* Apply suggestions from code review

Co-authored-by: DannyDaemonic <DannyDaemonic@gmail.com>

* remove

* minor

* minor

---------

Co-authored-by: jon-chuang <jon-chuang@users.noreply.github.com>
Co-authored-by: DannyDaemonic <DannyDaemonic@gmail.com>
 2023-04-30 21:41:35 +03:00
Folko-Ven 78ec543733 Correcting link to w64devkit (#1214) 
Correcting link to w64devkit (change seeto to skeeto).
 2023-04-28 16:22:48 +02:00
nanahi 2d3481c721 Fix msys2 build error and warnings (#1009) 2023-04-16 11:13:42 +02:00
niansa/tuxifan 107980d970 examples : add -n to alpaca and gpt4all scripts (#706) 2023-04-13 16:03:39 +03:00
Erik Scholz 34c1072e49 ci: add debug build to sanitizer build matrix (#527) 2023-03-26 15:48:40 +00:00
Juan Calderon-Perez 8c2ec5e21d Add support for linux/arm64 platform during Docker Builds (#514) 
* Add support for linux/arm64 platform

* Add platform to versioned builds
 2023-03-26 14:48:42 +00:00
jp-x-g f732695cd5 Clarify console output in convert-pth-to-ggml.py (#512) 
"Processing part 1 of 3" instead of "Processing part 0"
 2023-03-25 23:53:55 +02:00
nusu-github ad072fc5ad Generate library with CMake (#430) 
* Generate library with CMake

BUILD_SHARED_LIBS to allow llama library to be generated.

* Turn ON PIC when BUILD_SHARED_LIBS is ON
 2023-03-23 21:16:48 +01:00
Erik Scholz 4122dffff9 cmake: make llama an actual library (#392) 2023-03-22 18:37:10 +02:00
Erik Scholz 56e659a0b2 fix perplexity after c-api refactor (#390) 
* preallocate a buffer of fitting size for tokenization (utils.cpp)

* don't create a new std::string (especially here, where it's usually large)
 2023-03-22 18:09:38 +02:00
Erik Scholz 01a297b099 specify build type for ctest on windows (#371) 2023-03-21 23:34:25 +02:00
Jean-Christophe Hoelt 3ab3e6582f Add chatLLaMa script (#198) 
* Add chatLLaMa script

* Fix shellcheck errors and do some cleanup

* Move chatLLaMa script to `examples` directory

* Reduce chatLLaMa context size to 2048

Ref d7def1a752

* Include n_predict to 2048 in examples/chatLLaMa
 2023-03-21 18:23:15 +02:00
nusu-githubandGeorgi Gerganov 8cf9f34edd Adding missing features of CMakeLists.txt & Refactoring (#131) 
* Functionality addition CMakeLists.txt

Refactoring:
1. Simplify more options that are negation of negation.
LLAMA_NO_ACCELERATE -> LLAMA_ACCELERATE
2. Changed to an optional expression instead of forcing to enable AVX2 in MSVC.
3. Make CMAKE_CXX_STANDARD, which is different from Makefile, the same.
4. Use add_compile_options instead of adding options to CMAKE_C_FLAGS.
5. Make utils use target_link_libraries instead of directly referencing code.

Added features:
1. Added some options.
LLAMA_STATIC_LINK,LLAMA_NATIVE,LLAMA_LTO,LLAMA_GPROF,LLAMA_OPENBLAS

* Fix Accelerate link in CMake

* Windows build Fix

* C++11 to C++17

* Reflects C/C++ standard individually

* Change the version to 3.12

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-21 01:37:16 +01:00
Erik ScholzandTy Everett 0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
 2023-03-19 19:57:00 +02:00
Jean-Michaël Celerier 9dcf4dba45 Add missing headers for memcpy and assert (#3) 2023-03-11 01:04:06 +02:00