Models & Labs
v0.19.0rc1 Release Notes
vLLM Releasesmedium confidence
Why it matters
- →Bug fixes can enhance model performance and reliability.
- →Keeping software updated is crucial for developers to leverage improvements.
- →This release indicates ongoing maintenance and support for the vLLM project.
The v0.19.0rc1 release of vLLM has been announced, which includes a bug fix that restricts TRTLLM attention to SM100, addressing issues with GB300 (SM103). This update aims to improve the functionality and performance of the model. Users are encouraged to update to this release to benefit from the fixes implemented.
Read originalMore from vLLM Releases
More in Models & Labs
Models & Labsother
New release of llama.cpp b8991
The latest version b8991 of llama.cpp has been released, featuring updates for various operating systems.
llama.cpp Releases
Models & Labsother
llama.cpp update enhances compatibility and performance
The latest update to llama-mmap improves compatibility with various platforms and model sizes. Key enhancements include support for 32-bit wasm and updates to gguf.cpp style.
llama.cpp Releases
