4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
slaren	459e93cce0	Add AVX2 implementation of dequantize_row_q4_1 (#505)	2023-03-25 20:31:48 +02:00
slaren	09aecbf628	Add AVX2 implementation of dequantize_row_q4_0 (#467)	2023-03-25 17:06:49 +02:00
slaren	29b7baab67	Add timings for the prompt evaluation (#478)	2023-03-25 16:34:23 +02:00
slarenandGeorgi Gerganov	50fae10d03	Add --ignore-eos parameter (#181) ... Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-03-19 20:22:48 +02:00