This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 78837ef2c4f Update release process for providers to use RAT 0.17
(#57201)
78837ef2c4f is described below
commit 78837ef2c4fd33e8780f5ee000f4578af6836b16
Author: Jarek Potiuk <[email protected]>
AuthorDate: Fri Oct 24 18:03:09 2025 +0200
Update release process for providers to use RAT 0.17 (#57201)
RAT 0.17 has been released recently and it was quite a big change.
While we cannot use archive check that was released in 0.17
due to bug https://issues.apache.org/jira/projects/RAT/issues/RAT-511
we should still switch to it as it is going to be used in the
Apache Trusted Releases soon.
This change adds missing .rat-excludes and also updates the process
to produce nicer output.
---
.rat-excludes | 29 +++++++++++++++++++++++++++++
dev/README_RELEASE_PROVIDERS.md | 27 ++++++++++++++++++++-------
2 files changed, 49 insertions(+), 7 deletions(-)
diff --git a/.rat-excludes b/.rat-excludes
index 9dc420c33ad..a8851425239 100644
--- a/.rat-excludes
+++ b/.rat-excludes
@@ -187,3 +187,32 @@ mocks/*
# Kubernetes env
.env
+
+# Doc files
+/docs/.latest-doc-only-change.txt
+/docs/redirects.txt
+/docs/integration-logos/*.svg
+/docs/img/*.md5sum
+/docs/img/*.svg
+
+# Log files
+*.log
+
+# md5 sum files
+.*\.md5sum
+
+# Generated files
+*generated.*
+/src/airflow/providers/keycloak/auth_manager/openapi/v2-keycloak-auth-manager-generated.yaml
+/src/airflow/providers/edge3/plugins/www/*
+/src/airflow/providers/edge3/openapi/v2-edge-generated.yaml
+/src/airflow/providers/fab/auth_manager/api_fastapi/openapi/v2-fab-auth-manager-generated.yaml
+/src/airflow/providers/fab/www/static/dist/*
+/any/dag_id=dag_for_testing_redis_task_handler/run_id=test/task_id=task_for_testing_redis_log_handler/attempt=1.log
+/src/airflow/providers/google/ads/.gitignore
+
+# Vendored-in code
+/src/airflow/providers/google/_vendor/*
+
+# Git ignore file
+.gitignore
diff --git a/dev/README_RELEASE_PROVIDERS.md b/dev/README_RELEASE_PROVIDERS.md
index ed25421531c..0b41172e7e5 100644
--- a/dev/README_RELEASE_PROVIDERS.md
+++ b/dev/README_RELEASE_PROVIDERS.md
@@ -791,7 +791,7 @@ Set an environment variable: PATH_TO_SVN to the root of
folder where you have pr
``` shell
cd asf-dist/dev/airflow
-export PATH_TO_SVN=${pwd -P)
+export PATH_TO_SVN=$(pwd -P)
```
Optionally you can use the
[`check_files.py`](https://github.com/apache/airflow/blob/main/dev/check_files.py)
@@ -925,7 +925,7 @@ This can be done with the Apache RAT tool.
# Get rat if you do not have it
if command -v wget >/dev/null 2>&1; then
echo "Using wget to download Apache RAT..."
- wget -qO-
https://dlcdn.apache.org//creadur/apache-rat-0.16.1/apache-rat-0.16.1-bin.tar.gz
| gunzip | tar -C /tmp -xvf -
+ wget -qO-
https://dlcdn.apache.org//creadur/apache-rat-0.17/apache-rat-0.17-bin.tar.gz |
gunzip | tar -C /tmp -xvf -
else
echo "ERROR: wget not found. Install with: brew install wget (macOS) or
apt-get install wget (Linux)"
exit 1
@@ -941,15 +941,27 @@ done
# Generate list of unpacked providers
find . -type d -maxdepth 1 | grep -v "^.$"> /tmp/files.txt
# Check licences
-for d in $(cat /tmp/files.txt)
+for d in $(cat /tmp/files.txt | sort)
do
- pushd $d
- java -jar /tmp/apache-rat-0.16.1/apache-rat-0.16.1.jar -E
${AIRFLOW_REPO_ROOT}/.rat-excludes -d . 2>/dev/null | grep Unknown
- popd >/dev/null
+ pushd $d 2>&1 >/dev/null
+ echo "Checking licences for $d"
+ java -jar /tmp/apache-rat-0.17/apache-rat-0.17.jar --input-exclude-file
${AIRFLOW_REPO_ROOT}/.rat-excludes . 2>/dev/null | grep '! '
+ popd 2>&1 >/dev/null
done
```
-You should see only '0 Unknown licences"
+You should see output similar to:
+
+```
+Checking licences for ./apache_airflow_providers_airbyte-5.2.4
+Checking licences for ./apache_airflow_providers_alibaba-3.2.4
+Checking licences for ./apache_airflow_providers_amazon-9.16.0
+Checking licences for ./apache_airflow_providers_apache_beam-6.1.6
+Checking licences for ./apache_airflow_providers_apache_cassandra-3.8.3
+...
+```
+
+You will see there files that are considered problematic by RAT tool (RAT
prints such files preceding them with "! ").
Cleanup:
@@ -1050,6 +1062,7 @@ You should get output similar to:
```
Checking apache-airflow-providers-google-1.0.0rc1.tar.gz.sha512
Checking apache_airflow-providers-google-1.0.0rc1-py3-none-any.whl.sha512
+...
```
## Verify the release candidate by Contributors
