📦

llama.cpp

b12121
Official Release & Download Center • November 5, 2026

⚡ Release Highlights & Changelog

llama : fix on-device state copy sizes for quantized KV caches (#30541)

  • llama : fix on-device state copy sizes for quantized KV caches

The on-device sequence state copies (LLAMASTATESEQFLAGSON_DEVICE) computed

their element count as size / ggmlelementsize(). For a quantized type such as

q80 or q40 that is the number of blocks, not elements, so only part of each

range was copied: the restored state was wrong, or the copy crashed.

Compute the count as size / ggmltypesize() * ggmlblcksize() for the save,

the restore and the copy between differently chunked ranges, and assert that

each range covers whole blocks.

  • llama : drop the one-line comments
  • llama : drop the redundant cast in the state copy size

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

💾 Downloadable Packages & Binaries

📦 Archive
cudart-llama-b12121-bin-ubuntu-cuda-12.8-x64.tar.gz
(566.8 MB)
Download
📦 Archive
cudart-llama-b12121-bin-ubuntu-cuda-13.4-arm64.tar.gz
(526.9 MB)
Download
📦 Archive
cudart-llama-b12121-bin-ubuntu-cuda-13.4-x64.tar.gz
(419.8 MB)
Download
📦 Archive
cudart-llama-bin-win-cuda-12.4-x64.zip
(373.3 MB)
Download
📦 Archive
cudart-llama-bin-win-cuda-13.4-arm64.zip
(146.2 MB)
Download
📦 Archive
cudart-llama-bin-win-cuda-13.4-x64.zip
(403.9 MB)
Download
📦 Archive
llama-b12121-bin-android-arm64-snapdragon.tar.gz
(62.1 MB)
Download
📦 Archive
llama-b12121-bin-android-arm64.tar.gz
(76.4 MB)
Download
📦 Archive
llama-b12121-bin-linux-arm64-snapdragon.tar.gz
(24.4 MB)
Download
📦 Archive
llama-b12121-bin-macos-arm64.tar.gz
(15.9 MB)
Download
📦 Archive
llama-b12121-bin-macos-x64.tar.gz
(11.8 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-26.04-s390x.tar.gz
(15 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-arm64.tar.gz
(17.9 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-cuda-12.8-x64.tar.gz
(178.7 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-cuda-13.4-arm64.tar.gz
(155.8 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-cuda-13.4-x64.tar.gz
(160.5 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-openvino-2026.4.1-x64.tar.gz
(117 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-rocm-10.0-x64.tar.gz
(243.7 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-s390x.tar.gz
(16.8 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-sycl-fp16-x64.tar.gz
(63.9 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-sycl-fp32-x64.tar.gz
(63.8 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-vulkan-arm64.tar.gz
(27.8 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-vulkan-x64.tar.gz
(34.2 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-x64.tar.gz
(22 MB)
Download
📦 Archive
llama-b12121-bin-ubuntu-zdnn-s390x.tar.gz
(13.2 MB)
Download
📦 Archive
llama-b12121-bin-win-cpu-arm64.zip
(12.6 MB)
Download
📦 Archive
llama-b12121-bin-win-cpu-x64.zip
(23.6 MB)
Download
📦 Archive
llama-b12121-bin-win-cuda-12.4-x64.zip
(273.7 MB)
Download
📦 Archive
llama-b12121-bin-win-cuda-13.4-arm64.zip
(149.6 MB)
Download
📦 Archive
llama-b12121-bin-win-cuda-13.4-x64.zip
(161.4 MB)
Download
📦 Archive
llama-b12121-bin-win-opencl-adreno-arm64.zip
(13.6 MB)
Download
📦 Archive
llama-b12121-bin-win-openvino-2026.4.1-x64.zip
(99.9 MB)
Download
📦 Archive
llama-b12121-bin-win-rocm-10.0-x64.zip
(255.1 MB)
Download
📦 Archive
llama-b12121-bin-win-sycl-x64.zip
(148.8 MB)
Download
📦 Archive
llama-b12121-bin-win-vulkan-arm64.zip
(24.6 MB)
Download
📦 Archive
llama-b12121-bin-win-vulkan-x64.zip
(35.9 MB)
Download
📦 Archive
llama-b12121-ui.tar.gz
(3.1 MB)
Download
📦 Archive
llama-b12121-xcframework.zip
(72.6 MB)
Download
📦 Archive
Source code (b12121.zip)
(Source Code)
Download

ℹ️ About llama.cpp

ggml / ops / maintainer PRs%20sort%3Aupdated-desc) / dev stats / lib llama API / llama-server REST API

Original source: GitHub Releases
View original