Models
llama.cpp updates - granite-speech-4.1-2b, LFM2.5-ColBERT/Embedding-350M, Vulkan backend related changes & Misc items
The latest updates to llama.cpp include support for the granite-speech-4.1-2b model and the LFM2.5-ColBERT/Embedding-350M models. Significant enhancements to the Vulkan backend have been made, including support for 3D convolutions and various mathematical operations, which can improve performance in high-throughput scenarios. These updates are crucial for AI practitioners as they enhance model compatibility and computational efficiency, enabling better utilization of GPU resources.
llamaupdatesgranite-speech