o-nikolas commented on code in PR #29469: URL: https://github.com/apache/airflow/pull/29469#discussion_r1103359205
########## dev/README_RELEASE_PROVIDER_PACKAGES.md: ########## @@ -561,14 +561,41 @@ Or update it if you already checked it out: svn update . ``` -Optionally you can use `check_files.py` script to verify that all expected files are -present in SVN. This script may help also with verifying installation of the packages. +Optionally you can use the [`check_files.py`](https://github.com/apache/airflow/blob/main/dev/check_files.py) +script to verify that all expected files are present in SVN. This script will produce a `Dockerfile.pmc` which +may help with verifying installation of the packages. ```shell script # Copy the list of packages (pypi urls) into `packages.txt` then run: python check_files.py providers -p {PATH_TO_SVN} ``` +After the above script completes you can build `Dockerfile.pmc` to trigger an installation of each provider +package: + +```shell script +docker build - < Dockerfile.pmc +``` + +**Note**: This may fail to install some providers. For example, if they require some system level dependencies +that aren't present in the image. If you wish to investigate you may update the Dockerfile to install any +missing dependencies and then try to build again. + +For example, currently `apache-airflow-providers-apache-hive` requires the `libsasl2` system dependency. To Review Comment: I tested with this base image and it does indeed work nicely. I don't love that it's pinned to a specific python version (which will eventually need to be updated) but I think it's worth it to get this process to be more seamless. I'll update the PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
