Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
480 Commits 4 Branches 0 Tags
f4cef87edfd1b2f8d5befd4fde54ca2e03987bea
Commit Graph
4 Commits
Author SHA1 Message Date
Stephan Walter f0d70f147d Various fixes to mat_mul benchmark (#1253) 2023-04-30 12:32:37 +00:00
xaedes 0c5692345d examples : add save_load_state example (#1150) 
* add save_load_state example

* use <cstdio> instead of <iostream> and fprintf / printf instead of cout

* renamed save-load-state example files replacing underscores by dashes
 2023-04-24 19:23:31 +03:00
unbounded 62cfc54f77 Add quantize-stats command for testing quantization (#728) 
Command that calculates some statistics over the errors introduced by
quantization, like mean square error, max error and some percentile errors for layer
weights. Should be useful for testing quantization improvements.

Exposes some internal state from ggml and llama for testing
 2023-04-08 00:09:18 +02:00
Georgi Gerganov a316a425d0 Overhaul the examples structure 
- main -> examples
- utils -> examples (renamed to "common")
- quantize -> examples
- separate tools for "perplexity" and "embedding"

Hope I didn't break something !
 2023-03-25 20:26:40 +02:00