New3 developments · 1 source · over 5 days
llama.cpp b11046 adds OpenCL flash attention
How it developed
- llama.cpp ReleasesWhere it started
llama.cpp b11046 adds OpenCL flash attention
- llama.cpp Releases
llama.cpp adds Intel Xe flash attention optimization
- llama.cpp Releases
llama.cpp b11140 optimizes sparse attention on CUDA
llama.cpp b11140 optimizes sparse flash attention prefill for NVIDIA GPUs, reducing batched sparse ops from 586 to 244 microseconds