slaren and Georgi Gerganov
2a98bc18ea
ggml : add AVX2 implementation of quantize_row_q4_1 ( #515 )
...
* Add AVX2 implementation of quantize_row_q4_1
* Actually use AVX2
* Make quantize_row_q4_1 static
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-03-28 21:06:03 +03:00
slaren
a6bdc47cba
Fix usage of F16C intrinsics in AVX code ( #563 )
...
* Fix usage of F16C intrinsics in AVX code when F16C is not defined
2023-03-28 17:26:55 +03:00
slaren
459e93cce0
Add AVX2 implementation of dequantize_row_q4_1 ( #505 )
2023-03-25 20:31:48 +02:00
slaren
09aecbf628
Add AVX2 implementation of dequantize_row_q4_0 ( #467 )
2023-03-25 17:06:49 +02:00
slaren
29b7baab67
Add timings for the prompt evaluation ( #478 )
2023-03-25 16:34:23 +02:00
slaren and Georgi Gerganov
50fae10d03
Add --ignore-eos parameter ( #181 )
...
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-03-19 20:22:48 +02:00
