3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Erik Scholz	56e659a0b2	fix perplexity after c-api refactor (#390) ... * preallocate a buffer of fitting size for tokenization (utils.cpp) * don't create a new std::string (especially here, where it's usually large)	2023-03-22 18:09:38 +02:00
Erik Scholz	01a297b099	specify build type for ctest on windows (#371)	2023-03-21 23:34:25 +02:00
Erik ScholzandTy Everett	0b366e7357	Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) ... * Use F16 for memory_k and memory_v * add command line switch to use f16 instead of f32 for memory k+v --------- Co-authored-by: Ty Everett <ty@tyweb.us>	2023-03-19 19:57:00 +02:00