New2 developments · 1 source · over 4 days
llama.cpp b12059 optimizes unified KV cache for multi-sequence
How it developed
- llama.cpp ReleasesWhere it started
llama.cpp b12059 optimizes unified KV cache for multi-sequence
- llama.cpp Releases
llama.cpp adds Kimi K3.1-Pro support
llama.cpp adds Kimi K3.1-Pro support using DSA and linear-attention KDA layers