Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
7bd1808
mtmd : resize Gemma 4 images without letterbox padding (#30922)
boshjerns Oct 31, 2026
2871678
server : fix /v1/responses endpoint to accept extra_params (#30959)
Dgarc359 Oct 31, 2026
f3586e6
server: cap shared decision prefixes at the first output (#30710)
aiqubits Oct 31, 2026
ddf48f8
reshaping so mm on 2d instead of 3d tensor for lfm sc (#30831)
anthonymaltsev Oct 31, 2026
0138937
llama : fix rotation of attention tensors in layers with shared KV (#…
nikwen Oct 31, 2026
f6312ad
vendor : update miniaudio to 0.11.26 (#31459)
cabelo Oct 31, 2026
bc428e4
llama : enable tensor split for LFM3 (#31431)
tdakhran Oct 31, 2026
79bce0c
tests : enable Gemma 4 in `test-llama-archs` (#31401)
nikwen Oct 31, 2026
d5ef408
mtmd : fix InternVL CLS token order (#30886)
boshjerns Oct 31, 2026
a91eab6
hexagon : fix DMA transfers with strides > 24 bits (#31442)
marktodorovich Oct 31, 2026
060b2fe
opencl: add initial iq3 support (#31338)
shaofeiqi Nov 1, 2026
dde879b
sycl: Try PkgConfig for LevelZero includes / libs (#31076)
mctylr-gh Nov 1, 2026
785322d
requirements : fix numpy dependencies (#31508)
CISC Nov 1, 2026
1c5ed70
webgpu : fix CI by keeping scratch alloc sizes monotonic in batch len…
ServeurpersoCom Nov 2, 2026
4e910a8
cmake : add explicit thread linkage (#31414)
o7si Nov 2, 2026
fcfe4b5
requirements : minor adjustments for python 3.14 wheels (#31534)
CISC Nov 2, 2026
f72dc30
docs: fix Huawei ascend brand (#31463)
licy666 Nov 2, 2026
a7a490a
ggml : fix clang-cl build with AVX512 BF16 (#31276)
YagUber Nov 2, 2026
5969566
jinja : implement map('filter') (#24033)
MuoDoo Nov 2, 2026
00ef136
tests : merge identical if branches (#31523)
nikwen Nov 2, 2026
aac6da8
docs : fix Vulkan example command in build.md (#31530)
Septa2112 Nov 2, 2026
b12b405
ui: don't reload a loading model on select, prefer it in pre-selectio…
allozaur Nov 2, 2026
64be95b
ui: show interrupted state for tool calls that never returned (#31314)
allozaur Nov 2, 2026
90080ce
ui: keep queued steering messages in their own conversation (#31304)
allozaur Nov 2, 2026
23426d7
ui: align alert dialog styling with other overlay surfaces (#31312)
allozaur Nov 2, 2026
5c2ea1a
ui: disable model deletion the server would refuse (#31305)
allozaur Nov 2, 2026
cbbd7c2
ci: update to ubuntu26.04
taronaeo Oct 31, 2026
0926404
ci: bring back toolchain workaround
taronaeo Oct 31, 2026
c5c2353
ci: remove workaround completely
taronaeo Oct 31, 2026
11ead62
ci: more switching to ubuntu 26.04
taronaeo Oct 31, 2026
9643fc0
ci: pin android cmake version
taronaeo Nov 1, 2026
d95d957
ci: restore ubuntu 24.04 for s390x
taronaeo Nov 1, 2026
69c8d86
ci: fix missing s390x ubuntu 24.04 release link
taronaeo Nov 2, 2026
5f1cc38
ci: switch release-publish to ubuntu-latest
taronaeo Nov 2, 2026
377966a
devops: revert --break-system-packages
taronaeo Nov 2, 2026
0d51049
ci: bring back ubuntu 24.04 for arm release
taronaeo Nov 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 2 additions & 4 deletions .devops/cpu.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
ARG UBUNTU_VERSION=24.04
ARG UBUNTU_VERSION=26.04
ARG BUILD_DATE=N/A
ARG APP_VERSION=N/A
ARG APP_REVISION=N/A
Expand All @@ -22,9 +22,7 @@ FROM docker.io/ubuntu:$UBUNTU_VERSION AS build
ARG TARGETARCH

RUN apt-get update && \
apt-get install -y gcc-14 g++-14 build-essential git cmake libssl-dev

ENV CC=gcc-14 CXX=g++-14
apt-get install -y build-essential git cmake libssl-dev

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build-3rd-party.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,8 @@ env:
LLAMA_ARG_LOG_TIMESTAMPS: 1

jobs:
ubuntu-24-llguidance:
runs-on: ${{ 'ubuntu-24.04-arm' || 'ubuntu-24.04' }}
ubuntu-26-llguidance:
runs-on: ${{ 'ubuntu-26.04-arm' || 'ubuntu-26.04' }}

steps:
- name: Clone
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/build-and-test-snapdragon.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ concurrency:

jobs:
android-ndk-snapdragon:
runs-on: ubuntu-24.04 # previously ubuntu-latest
runs-on: ubuntu-26.04
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.8'
defaults:
Expand Down Expand Up @@ -67,7 +67,7 @@ jobs:
path: pkg-snapdragon/llama.cpp

linux-iot-snapdragon:
runs-on: ubuntu-24.04 # previously ubuntu-latest
runs-on: ubuntu-26.04
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-linux:v0.8'
defaults:
Expand Down Expand Up @@ -103,7 +103,7 @@ jobs:
test-snapdragon-qdc:
name: Test on QDC Device (${{ matrix.device }})
needs: [android-ndk-snapdragon, linux-iot-snapdragon]
runs-on: ubuntu-24.04-arm
runs-on: ubuntu-26.04-arm
timeout-minutes: 180
strategy:
fail-fast: false
Expand Down
7 changes: 4 additions & 3 deletions .github/workflows/build-android.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ env:

jobs:
default:
runs-on: ubuntu-24.04 # previously ubuntu-latest
runs-on: ubuntu-26.04

steps:
- name: Clone
Expand All @@ -56,14 +56,15 @@ jobs:
uses: android-actions/setup-android@be39fa834029ff78f1a44aa3bb0819b8fc2bd8fd # v4.0.4
with:
log-accepted-android-sdk-licenses: false
packages: platform-tools cmake;3.31.6

- name: Build
run: |
cd examples/llama.android
./gradlew build --no-daemon
ndk:
runs-on: ubuntu-24.04 # previously ubuntu-latest
runs-on: ubuntu-26.04
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.3'
defaults:
Expand Down Expand Up @@ -101,7 +102,7 @@ jobs:
path: pkg-adb/llama.cpp

arm64:
runs-on: ubuntu-24.04 # previously ubuntu-latest
runs-on: ubuntu-26.04

env:
NDK_VERSION: "29.0.14206865"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/build-cache.yml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ jobs:
# version: ${{ env.SPACEMIT_IME_TOOLCHAIN_VERSION }}

ubuntu-24-openvino-cache:
runs-on: ubuntu-24.04
runs-on: ubuntu-26.04

env:
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
Expand Down
11 changes: 2 additions & 9 deletions .github/workflows/build-cpu.yml
Original file line number Diff line number Diff line change
Expand Up @@ -55,9 +55,9 @@ jobs:
matrix:
include:
- build: 'x64'
os: ubuntu-22.04
os: ubuntu-26.04
- build: 'arm64'
os: ubuntu-24.04-arm
os: ubuntu-26.04-arm

runs-on: ${{ matrix.os }}

Expand All @@ -81,13 +81,6 @@ jobs:
libjpeg-dev build-essential libssl-dev \
git-lfs

- name: Toolchain workaround (GCC 14)
if: ${{ contains(matrix.os, 'ubuntu-24.04') }}
run: |
sudo apt-get install -y gcc-14 g++-14
echo "CC=gcc-14" >> "$GITHUB_ENV"
echo "CXX=g++-14" >> "$GITHUB_ENV"

- name: Python Dependencies
id: python_depends
run: |
Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/build-cross.yml
Original file line number Diff line number Diff line change
Expand Up @@ -163,7 +163,7 @@ jobs:
# cmake --build build --config Release -j $(nproc)

debian-13-loongarch64-cpu-cross:
runs-on: ${{ 'ubuntu-24.04-arm' || 'ubuntu-24.04' }}
runs-on: ${{ 'ubuntu-26.04-arm' || 'ubuntu-26.04' }}
container: debian@sha256:653dfb9f86c3782e8369d5f7d29bb8faba1f4bff9025db46e807fa4c22903671

steps:
Expand Down Expand Up @@ -218,7 +218,7 @@ jobs:
cmake --build build --config Release -j $(nproc)
debian-13-loongarch64-vulkan-cross:
runs-on: ${{ 'ubuntu-24.04-arm' || 'ubuntu-24.04' }}
runs-on: ${{ 'ubuntu-26.04-arm' || 'ubuntu-26.04' }}
container: debian@sha256:653dfb9f86c3782e8369d5f7d29bb8faba1f4bff9025db46e807fa4c22903671

steps:
Expand Down Expand Up @@ -276,8 +276,8 @@ jobs:
cmake --build build --config Release -j $(nproc)
ubuntu-24-riscv64-cpu-spacemit-ime-cross:
runs-on: ubuntu-24.04
ubuntu-26-riscv64-cpu-spacemit-ime-cross:
runs-on: ubuntu-26.04

env:
# Make sure this is in sync with build-cache.yml
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build-sanitize.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,9 +45,9 @@ jobs:
include:
# thread and address doesn't run properly on some self hosted machines, so run it on Github instead
- sanitizer: ADDRESS
machine: ubuntu-24.04
machine: ubuntu-26.04
- sanitizer: THREAD
machine: ubuntu-24.04
machine: ubuntu-26.04
- sanitizer: UNDEFINED
machine: [self-hosted, X64, Linux, CPU]

Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/build-sycl.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ env:
LLAMA_ARG_LOG_TIMESTAMPS: 1

jobs:
ubuntu-24-sycl:
ubuntu-26-sycl:
strategy:
matrix:
build: [fp32, fp16]
Expand All @@ -48,7 +48,7 @@ jobs:
- build: fp16
fp16: ON

runs-on: ubuntu-24.04
runs-on: ubuntu-26.04

env:
ONEAPI_ROOT: /opt/intel/oneapi/
Expand Down Expand Up @@ -103,7 +103,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: sycl-ubuntu-24-${{ matrix.build }}
key: sycl-ubuntu-26-${{ matrix.build }}
folder: llama.cpp
hf_bucket: ggml-org/cache

Expand Down Expand Up @@ -131,7 +131,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: sycl-ubuntu-24-${{ matrix.build }}
key: sycl-ubuntu-26-${{ matrix.build }}
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build-virtgpu.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,8 @@ concurrency:
cancel-in-progress: true

jobs:
ubuntu-24-virtgpu:
runs-on: ${{ 'ubuntu-24.04-arm' || 'ubuntu-24.04' }}
ubuntu-26-virtgpu:
runs-on: ${{ 'ubuntu-26.04-arm' || 'ubuntu-26.04' }}

steps:
- name: Clone
Expand Down
16 changes: 7 additions & 9 deletions .github/workflows/build-vulkan.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ env:

jobs:
ubuntu-arm64:
runs-on: ubuntu-24.04-arm
runs-on: ubuntu-26.04-arm

steps:
- name: Clone
Expand All @@ -53,9 +53,7 @@ jobs:
id: depends
run: |
sudo apt-get update
sudo apt-get install -y gcc-14 g++-14 build-essential glslc libvulkan-dev spirv-headers libssl-dev ninja-build
echo "CC=gcc-14" >> "$GITHUB_ENV"
echo "CXX=g++-14" >> "$GITHUB_ENV"
sudo apt-get install -y build-essential glslc libvulkan-dev spirv-headers libssl-dev ninja-build
- name: ccache
uses: ggml-org/ccache-action@v1.2.24
Expand All @@ -69,7 +67,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: vulkan-ubuntu-24.04-arm
key: vulkan-ubuntu-26.04-arm
folder: llama.cpp
hf_bucket: ggml-org/cache

Expand All @@ -92,14 +90,14 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: vulkan-ubuntu-24.04-arm
key: vulkan-ubuntu-26.04-arm
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
save: true

ubuntu-llvmpipe:
runs-on: ubuntu-24.04
runs-on: ubuntu-26.04

steps:
- name: Clone
Expand Down Expand Up @@ -137,7 +135,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: vulkan-ubuntu-24.04-llvmpipe
key: vulkan-ubuntu-26.04-llvmpipe
folder: llama.cpp
hf_bucket: ggml-org/cache

Expand All @@ -156,7 +154,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: vulkan-ubuntu-24.04-llvmpipe
key: vulkan-ubuntu-26.04-llvmpipe
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/build-wasi.yml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ env:

jobs:
ubuntu-webgpu:
runs-on: ubuntu-24.04-arm
runs-on: ubuntu-26.04-arm

steps:
- name: Clone
Expand Down Expand Up @@ -97,7 +97,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: webgpu-ubuntu-24.04-arm-wasi
key: webgpu-ubuntu-26.04-arm-wasi
folder: llama.cpp
hf_bucket: ggml-org/cache

Expand Down Expand Up @@ -135,7 +135,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: webgpu-ubuntu-24.04-arm-wasi
key: webgpu-ubuntu-26.04-arm-wasi
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/build-wasm.yml
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ env:

jobs:
ubuntu-webgpu:
runs-on: ubuntu-24.04-arm
runs-on: ubuntu-26.04-arm

steps:
- name: Clone
Expand Down Expand Up @@ -84,7 +84,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: webgpu-ubuntu-24.04-arm-wasm
key: webgpu-ubuntu-26.04-arm-wasm
folder: llama.cpp
hf_bucket: ggml-org/cache

Expand All @@ -107,7 +107,7 @@ jobs:
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: webgpu-ubuntu-24.04-arm-wasm
key: webgpu-ubuntu-26.04-arm-wasm
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build-webgpu.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ env:

jobs:
format:
runs-on: ubuntu-24.04
runs-on: ubuntu-26.04

steps:
- name: Clone
Expand All @@ -45,7 +45,7 @@ jobs:
wget -qO- https://apt.llvm.org/llvm-snapshot.gpg.key |
sudo tee /etc/apt/trusted.gpg.d/apt.llvm.org.asc > /dev/null
sudo add-apt-repository -y \
"deb http://apt.llvm.org/noble/ llvm-toolchain-noble-22 main"
"deb http://apt.llvm.org/resolute/ llvm-toolchain-resolute-22 main"
sudo apt-get update
sudo apt-get install -y clang-format-22
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/copilot-setup-steps.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ cache-mode: none
jobs:
# The job MUST be called `copilot-setup-steps` or it will not be picked up by Copilot.
copilot-setup-steps:
runs-on: ubuntu-24.04
runs-on: ubuntu-26.04

# Set the permissions to the lowest permissions possible needed for your steps.
# Copilot will be given its own token for its operations.
Expand Down
Loading
Loading