Lumpiasty/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,398 Commits 4 Branches 0 Tags
4e82b2ea3fa6482915d147bc9f46e70b9ada7700
Commit Graph
6 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shibe2 1117d06607 opencl : fix element-wise multiplication (#3656) 2023-10-18 15:09:22 +03:00
shibe2 40e5ce054f CLBlast: Fix temporary buffer size for f16 conversion (wsize) 
Fix buffer overflow.
Reduce the size to fit just one 2D slice.
Assert sufficient size.
 2023-10-17 21:02:30 +04:00
shibe2 1e0e873c37 CLBlast: Fix matrix-vector multiplication (#3544) 2023-10-12 21:59:47 +02:00
shibe2 e2583cbc29 CLBlast: Fix handling of on-device tensor data 
Fix uploading tensor data to device, including 3D, 4D, and non-contiguous tensors.
Use correct offsets into data that is already in VRAM.
Correct handling of OpenCL events when multiple commands are queued.
 2023-10-05 18:25:23 +04:00
shibe2 665018c749 CLBlast: Add broadcast support for matrix multiplication (#3402) 
Broadcast src0 into src1 across dimensions 2 and 3 when needed.
This is required for models that use GQA.
 2023-10-02 21:26:15 +02:00
shibe2 36b904e200 ggml-opencl.cpp: Make private functions static (#3300) 2023-09-21 14:10:26 -04:00