Expose generation timings from server & update completions.js (#2116)
* use javascript generators as much cleaner API Also add ways to access completion as promise and EventSource * export llama_timings as struct and expose them in server * update readme, update baked includes * llama : uniform variable names + struct init --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
This commit is contained in:
1 parent
983b555e9d
commit
31cfbb1013
9 files changed
+1921
-1363
No files matched your search
+505
-316
File diff suppressed because it is too large.
Load diff
Reference in new issue
Block a user