Expose generation timings from server & update completions.js (#2116)

* use javascript generators as much cleaner API

Also add ways to access completion as promise and EventSource

* export llama_timings as struct and expose them in server

* update readme, update baked includes

* llama : uniform variable names + struct init

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
This commit is contained in:
Tobias LütkeandGeorgi Gerganov authored and GitHub committed 2023-07-05 16:51:13 -04:00
1 parent 983b555e9d
commit 31cfbb1013
9 files changed
+1921 -1363

No files matched your search

+505 -316
View File
File diff suppressed because it is too large. Load diff