Commit Graph

Select branches

Hide Pull Requests

fable5/prefetch-experts

fable5/vram-ondemand

fable5/vram-ondemand-rebased-20260726

gemini

Mono Color

• 6f61c18ec9 Fix typo in readme Pavol Rusnak 2023-03-18 22:39:46 +01:00
• 1e5a6d088d Add note about Python 3.11 to readme Pavol Rusnak 2023-03-18 22:20:04 +01:00
• 554b541521 Add memory/disk requirements to readme Pavol Rusnak 2023-03-18 21:58:46 +01:00
• d3f202d57b Remove unused code since n_vocab is model.hparams.n_vocab (#262) Alex NguyenandGitHub 2023-03-18 20:51:49 +07:00
• e03e359730 fixed warning with std::ignore about unused function result (#151) Justin SuessandGitHub 2023-03-18 07:44:09 -04:00
• a81d0c2a17 Fix n^2 loop in tokenization (#254) Gary LinscottandGitHub 2023-03-18 04:17:19 -07:00
• b2de7f18df CI Improvements (#230) anzz1andGitHub 2023-03-18 09:27:12 +02:00
• a292747893 Nix flake (#40) 3 people 2023-03-17 23:03:48 +01:00
• c9f670a177 Implement non-greedy tokenizer that tries to maximize token lengths (#242) 3 people 2023-03-17 21:05:58 +01:00
• 4f54609110 Default to 4 threads (#243) Georgi Gerganov 2023-03-17 21:46:46 +02:00
• e81b9c81c1 Update Contributing section Georgi GerganovandGitHub 2023-03-17 20:30:04 +02:00
• 367946c668 Don't tell users to use a bad number of threads (#243) Stephan WalterandGitHub 2023-03-17 17:47:35 +00:00
• 6b0df5ccf3 add ptread link to fix cmake build under linux (#114) 3 people 2023-03-18 00:38:24 +08:00
• 2af23d3043 🚀 Dockerize llamacpp (#132) 3 people 2023-03-17 10:47:06 +01:00
• 904d2a8d6a Q4_1 quantization (#193) Matvey SolovievandGitHub 2023-03-17 05:48:39 +01:00
• 721311070e Update README.md Georgi GerganovandGitHub 2023-03-16 15:00:09 +02:00
• ac15de7895 Expand "Contributing" section Georgi GerganovandGitHub 2023-03-16 08:55:13 +02:00
• 273abc47ff Update hot topics - RMSnorm Georgi GerganovandGitHub 2023-03-16 07:12:12 +02:00
• 9b4a15b17d Fix RMS norm in GGML (#191) NebulaandGitHub 2023-03-15 19:29:25 -04:00
• 6eac39ba95 Add RMS norm and use it (#187) hoangmitandGitHub 2023-03-15 18:41:38 -04:00
• 27944c4206 fixed typo (#178) moritzbrantnerandGitHub 2023-03-15 21:35:25 +01:00
• 2d15d6c9a9 add SIGINT support for _WIN32 environments (#120) Rickey Bowers JrandGitHub 2023-03-15 13:56:24 -06:00
• 2d64715ad4 added ctx_size parameter (#148) 3 people 2023-03-15 15:42:40 -04:00
• 16b2c61a22 fixed color reset on exit (#149) 3 people 2023-03-15 15:39:38 -04:00
• 977295c700 Fix potential licensing issue (#126) Musab GultekinandGitHub 2023-03-15 22:39:06 +03:00
• 956dfda8ad Use tokenizer.vocab_size() instead of hardcoding 32000 in convert-pth-to-ggml.py (#142) RonsorandGitHub 2023-03-15 12:37:50 -07:00
• 113e685d18 inline -> static inline for "bytesFromNibbles" (#161) hoangmitandGitHub 2023-03-15 15:05:14 -04:00
• 47857e564c Don't use vdotq_s32 if it's not available (#139) 3 people 2023-03-14 12:34:37 -07:00
• 60f819a2b1 Add section to README on how to run the project on Android (#130) Radoslav GerganovandGitHub 2023-03-14 15:30:08 +02:00
• 97ab2b2578 Add Misc section + update hot topics + minor fixes Georgi GerganovandGitHub 2023-03-14 09:43:52 +02:00
• 2f700a2738 Add windows to the CI (#98) Sebastián AandGitHub 2023-03-13 17:29:10 -03:00
• c09a9cfb06 CMake build in Release by default (#75) Georgi Gerganov 2023-03-13 21:22:15 +02:00
• 7ec903d3c1 Update contribution section, hot topics, limitations, etc. Georgi GerganovandGitHub 2023-03-13 19:21:51 +02:00
• 4497ad819c Print system information Georgi Gerganov 2023-03-13 19:15:08 +02:00
• ed6849cc07 Initial support for CMake (#75) Sebastián AandGitHub 2023-03-13 14:12:33 -03:00
• 41be0a3b3d Add NetBSD support. (#90) Thomas KlausnerandGitHub 2023-03-13 17:40:54 +01:00
• 671d5cac15 Use fprintf for diagnostic output (#48) Pavol RusnakandGitHub 2023-03-13 17:39:56 +01:00
• 84d9015c4a Use vdotq_s32 to improve performance (#67) Georgi GerganovandGitHub 2023-03-13 18:36:44 +02:00
• 63fd76fbb0 Reduce model loading time (#43) 3 people 2023-03-14 01:33:43 +09:00
• 2a20f48efa Fix UTF-8 handling (including colors) (#79) Val KharitonovandGitHub 2023-03-13 12:24:18 -04:00
• d1f224712d Add quantize script for batch quantization (#92) 3 people 2023-03-13 17:15:20 +01:00
• 1808ee0500 Add initial contribution guidelines Georgi GerganovandGitHub 2023-03-13 09:42:26 +02:00
• a169bb889c Gate signal support on being on a unixoid system. (#74) Matvey Soloviev 2023-03-13 04:08:01 +01:00
• 460c482540 Fix token count accounting Matvey Soloviev 2023-03-13 00:35:51 +01:00
• c80e2a8f2a Revert "10% performance boost on ARM" Georgi Gerganov 2023-03-13 01:28:08 +02:00
• 54a0e66ea0 Check for vdotq_s32 availability Georgi Gerganov 2023-03-13 01:21:03 +02:00
• 543c57e991 Ammend to previous commit - forgot to update non-QRDMX branch Georgi Gerganov 2023-03-13 01:05:24 +02:00
• 113a9e83eb 10% performance boost on ARM Georgi Gerganov 2023-03-13 00:56:10 +02:00
• 404fac0d62 Fix color getting reset before prompt output done (#65) Matvey SolovievandGitHub 2023-03-12 23:07:34 +01:00
• 1a0a74300f Update README.md Georgi GerganovandGitHub 2023-03-12 23:39:01 +02:00
• 96ea727f47 Add interactive mode (#61) Matvey SolovievandGitHub 2023-03-12 22:13:28 +01:00
• 9661954835 Fix typo in README (#45) Marc KöhlbruggeandGitHub 2023-03-13 03:30:08 +07:00
• f385f8dee8 Allow using prompt files (#59) Ben GarneyandGitHub 2023-03-12 13:28:36 -07:00
• 02f0c6fe7f Add back top_k (#56) 4 people 2023-03-12 16:23:15 -04:00
• eb062bb012 Windows fixes (#31) Sebastián AandGitHub 2023-03-12 17:15:00 -03:00
• 7027a97837 Update README.md Georgi GerganovandGitHub 2023-03-12 22:09:26 +02:00
• 2d555e5b42 Add CI (#60) Georgi GerganovandGitHub 2023-03-12 22:08:24 +02:00
• 7c9e54e55e Revert "weights_only" arg - this causing more trouble than help Georgi Gerganov 2023-03-12 20:59:01 +02:00
• b9bd1d0141 python/pytorch compat notes (#44) Oleksandr NikitinandGitHub 2023-03-12 14:16:33 +02:00
• 129c7d1ea8 Add repetition penalty (#20) 3 people 2023-03-12 05:27:42 -04:00
• 702fddf5c5 Clarify meaning of hacking Georgi GerganovandGitHub 2023-03-12 09:03:25 +02:00
• 7d86e25bf6 README: add "Supported platforms" + update hot topics Georgi GerganovandGitHub 2023-03-12 08:41:54 +02:00
• a93120236f use weights_only in conversion script (#32) deepdiffuserandGitHub 2023-03-11 22:36:35 -08:00
• 6a9a67f0be Add LICENSE (#21) Pavol RusnakandGitHub 2023-03-12 07:36:03 +01:00
• da1a4ff01f Update README.md Georgi GerganovandGitHub 2023-03-12 01:26:32 +02:00
• 6b2cb6302f Fix a typo in model name (#16) Juraj BednarandGitHub 2023-03-11 18:32:20 +01:00
• 4235e3d5b3 Update README.md Georgi GerganovandGitHub 2023-03-11 18:10:18 +02:00
• f1eaff4721 Add AVX2 support for x86 architectures thanks to @Const-me ! Georgi Gerganov 2023-03-11 17:58:18 +02:00
• a9e58529ea Fix un-initialized FP16 tables on x86 (#15, #2) Georgi Gerganov 2023-03-11 17:40:14 +02:00
• 7d9ed7b25f Bump memory buffer Georgi Gerganov 2023-03-11 12:44:21 +02:00
• 0c6803321c Update README.md Georgi GerganovandGitHub 2023-03-11 12:31:21 +02:00
• f60fa9e50a .gitignore models/ Georgi Gerganov 2023-03-11 12:26:46 +02:00
• 7211862c94 Update Makefile var + add comment Georgi Gerganov 2023-03-11 12:26:16 +02:00
• a5c5ae2f54 Update README.md Georgi GerganovandGitHub 2023-03-11 11:34:25 +02:00
• ea977e85ec Update README.md Georgi GerganovandGitHub 2023-03-11 11:34:11 +02:00
• 007a8f6f45 Support all LLaMA models + change Q4_0 quantization storage Georgi Gerganov 2023-03-11 10:47:09 +02:00
• 5f2f970d51 Include Python dependencies in README (#6) Simon WillisonandGitHub 2023-03-10 21:47:26 -08:00
• 73c6ed5e87 Update README.md Georgi GerganovandGitHub 2023-03-11 01:30:47 +02:00
• 01eeed8fb1 Update README.md Georgi GerganovandGitHub 2023-03-11 01:22:58 +02:00
• 6da2df34ee Update README.md Georgi GerganovandGitHub 2023-03-11 01:18:10 +02:00
• 9dcf4dba45 Add missing headers for memcpy and assert (#3) Jean-Michaël CelerierandGitHub 2023-03-10 18:04:06 -05:00
• 920a7fe2d9 Update README.md Georgi GerganovandGitHub 2023-03-11 00:55:22 +02:00
• 3a57ee59de Update README.md Georgi GerganovandGitHub 2023-03-11 00:51:46 +02:00
• b85028522d Update README.md Georgi GerganovandGitHub 2023-03-11 00:09:19 +02:00
• 8a01f565ff Update README.md Georgi GerganovandGitHub 2023-03-10 23:53:11 +02:00
• 70bc0b8b15 Fix a bug in the rope calculation Georgi Gerganov 2023-03-10 23:46:39 +02:00
• 18ebda34d6 Update README.md Georgi GerganovandGitHub 2023-03-10 21:52:27 +02:00
• 319cdb3e1f Final touches Georgi Gerganov 2023-03-10 21:50:46 +02:00
• 775328064e Create README.md Georgi GerganovandGitHub 2023-03-10 21:47:46 +02:00
• 26c0846629 Initial release Georgi Gerganov 2023-03-10 20:40:58 +02:00