Skip to content

Conversation

@Techassi
Copy link
Member

@Techassi Techassi commented Jan 19, 2026

Part of #1370

This PR primarily adds Airflow 3.1.5 while also removing 2.10.5 and 3.0.1. Significant changes are:

  • The new Airflow version uses Node 22, a newer s3fs version, and a newer cyclonedx-bom generator
  • Cython needs to be constrained to >= 3.1.0

Some of these changes might be able to be included in older Airflow versions if possible and/or wanted.

Successfully built 1 image:
oci.stackable.tech/sdp/airflow:3.1.5-stackable0.0.0-dev-amd64

CI test build: https://github.com/stackabletech/docker-images/actions/runs/21144140078

It should be noted that Cython had to be constrained to >= 3.1.0
which means no specific version is used. This is due to conflicts
when gssapi and krb5 are built. gssapi (1.10.1)  requires 3.1.3,
but krb5 (0.9.0) requires 3.2.1.

It might additionally also be possible to use Python 3.13 and a
newer uv version, as Airflow supports Python 3.13 and uses uv
0.9.x. This will we explored in a future commit.

The cyclonedx-bom generator was bumped to the latest version, but
that now requires an if statement in the Dockerfile. It might be
possible to also use the newer version for Airflow 3.0.6.
@Techassi Techassi self-assigned this Jan 19, 2026
@Techassi Techassi moved this to Development: In Progress in Stackable Engineering Jan 19, 2026
@Techassi Techassi marked this pull request as ready for review January 19, 2026 16:02
@Techassi Techassi moved this from Development: In Progress to Development: Waiting for Review in Stackable Engineering Jan 19, 2026
@NickLarsenNZ NickLarsenNZ moved this from Development: Waiting for Review to Development: In Review in Stackable Engineering Jan 19, 2026
Copy link
Member

@NickLarsenNZ NickLarsenNZ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@NickLarsenNZ NickLarsenNZ added this pull request to the merge queue Jan 19, 2026
Merged via the queue into main with commit 53b02df Jan 19, 2026
15 checks passed
@NickLarsenNZ NickLarsenNZ deleted the chore/bump-airflow-for-26.3 branch January 19, 2026 19:53
@Techassi Techassi moved this from Development: In Review to Development: Done in Stackable Engineering Jan 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Development: Done

Development

Successfully merging this pull request may close these issues.

3 participants