New3 developments · 1 source · over 5 days

llama.cpp b11046 adds OpenCL flash attention

How it developed

  1. llama.cpp ReleasesWhere it started

    llama.cpp b11046 adds OpenCL flash attention

  2. llama.cpp Releases

    llama.cpp adds Intel Xe flash attention optimization

  3. llama.cpp Releases

    llama.cpp b11140 optimizes sparse attention on CUDA

    llama.cpp b11140 optimizes sparse flash attention prefill for NVIDIA GPUs, reducing batched sparse ops from 586 to 244 microseconds