
Replicate Blog reports significant improvements in the cold boot time for fine-tuned models, now achieving boot times of less than one second.
Read originalThe latest version b8991 of llama.cpp has been released, featuring updates for various operating systems.
The latest update to llama-mmap improves compatibility with various platforms and model sizes. Key enhancements include support for 32-bit wasm and updates to gguf.cpp style.
