See <https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Cron/2816/display/redirect?page=changes>
Changes: [yiru] . [yiru] . [yiru] . [yiru] format fix [yiru] . [yiru] make DoFn into a separate class [yiru] . [yiru] fix setting [yiru] fix checkstyle [yiru] spotlessapply [noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API [noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link [noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam [noreply] Update Changes.md w/Go pipeline pre-process fix. [noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088) [noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition ------------------------------------------ [...truncated 1.61 MB...] Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=c65f017245732cbdc1d25154f65034507c7025c05b67b71051406afa693f3d57 Stored in directory: /root/.cache/pip/wheels/1b/3a/02/8d8da2bca2223dda2f827949c88b2d82dc85dccbc2bb6265e5 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m > Task :sdks:python:container:py39:docker FAILED ---> Running in 39c47d08948f Removing intermediate container 39c47d08948f ---> 2ff79bc77ec2 Step 26/31 : COPY target/license_scripts /tmp/license_scripts/ ---> 02c9bef525b3 Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in d6a4b21b98b5 Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=cc4a08c197d0b7fd14e58f1015412b53d26f28c2ec12e21b74dc819fc91cb245 Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mTraceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module> [0m[91m from pip._internal.utils.misc import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/bin/pip-licenses", line 5, in <module> [0m[91m from piplicenses import main File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module> [0m[91m from pip import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py) [0m[91mTraceback (most recent call last): File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module> [0m[91m dependencies = run_pip_licenses() File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses [0m[91m dependencies = run_bash_command(command) File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command [0m[91m return subprocess.check_output(command.split()).decode('utf-8') File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output [0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/local/lib/python3.9/subprocess.py", line 528, in run [0m[91m raise CalledProcessError(retcode, process.args, [0m[91msubprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1. [0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1 :sdks:python:container:py39:docker (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 12 mins 44.727 secs. > Task :sdks:python:container:py36:docker Removing intermediate container 3afc1e6caf16 ---> 1dd16a461a8e Step 16/31 : COPY target/LICENSE /opt/apache/beam/ ---> 889d7d8f9829 Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/ ---> dd554394f5a2 Step 18/31 : COPY target/NOTICE /opt/apache/beam/ ---> 7ef21e405572 Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 77ce667e3171 Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in b468f1be7781 Removing intermediate container b468f1be7781 ---> 01855d3876ba Step 21/31 : FROM beam as third_party_licenses ---> 01855d3876ba Step 22/31 : ARG pull_licenses ---> Running in f4ab1224ae36 Removing intermediate container f4ab1224ae36 ---> 9874b84b051f Step 23/31 : COPY target/license_scripts /tmp/license_scripts/ ---> 1d7d2b7be30d Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 2b799838d0d4 Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in d1645c77c1f5 Removing intermediate container d1645c77c1f5 ---> fed42c51feaf Step 26/31 : COPY target/license_scripts /tmp/license_scripts/ ---> 47e0c06d593a Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in e8c712f82854 Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.6/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.6/site-packages (from tenacity) (1.15.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=e4b94ffa1870c37bba12ba33814ee7ddaddaa6cce77fdec6d634a080eb858cd9 Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0m > Task :sdks:python:container:py38:docker FAILED [91mTraceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/piplicenses.py", line 40, in <module> from pip._internal.utils.misc import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.8/site-packages/pip/_internal/utils/misc.py) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/bin/pip-licenses", line 5, in <module> from piplicenses import main File "/usr/local/lib/python3.8/site-packages/piplicenses.py", line 42, in <module> from pip import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.8/site-packages/pip/__init__.py) [0m[91mTraceback (most recent call last): File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module> dependencies = run_pip_licenses() File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses dependencies = run_bash_command(command) File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command return subprocess.check_output(command.split()).decode('utf-8') File "/usr/local/lib/python3.8/subprocess.py", line 415, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/local/lib/python3.8/subprocess.py", line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1. [0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1 :sdks:python:container:py38:docker (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 12 mins 45.711 secs. > Task :sdks:python:container:py37:docker FAILED Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mTraceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/piplicenses.py", line 40, in <module> from pip._internal.utils.misc import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.7/site-packages/pip/_internal/utils/misc.py) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/bin/pip-licenses", line 5, in <module> from piplicenses import main File "/usr/local/lib/python3.7/site-packages/piplicenses.py", line 42, in <module> from pip import get_installed_distributions ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.7/site-packages/pip/__init__.py) [0m[91mTraceback (most recent call last): File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module> dependencies = run_pip_licenses() File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses dependencies = run_bash_command(command) File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command return subprocess.check_output(command.split()).decode('utf-8') File "/usr/local/lib/python3.7/subprocess.py", line 411, in check_output **kwargs).stdout File "/usr/local/lib/python3.7/subprocess.py", line 512, in run output=stdout, stderr=stderr) subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1. [0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1 :sdks:python:container:py37:docker (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 12 mins 45.741 secs. > Task :sdks:python:container:py36:docker [91mINFO:root:Successfully pulled licenses for 139 dependencies [0mSkip pulling license for bs4 Removing intermediate container e8c712f82854 ---> 2618e2e08f43 Step 28/31 : FROM beam ---> 01855d3876ba Step 29/31 : ARG pull_licenses ---> Running in 12f034e709b8 Removing intermediate container 12f034e709b8 ---> 0cc187a19094 Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 615006fe0ff8 Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 27c2146b279a Removing intermediate container 27c2146b279a ---> a8bbcd209297 Successfully built a8bbcd209297 Successfully tagged apache/beam_python3.6_sdk:2.38.0.dev :sdks:python:container:py36:docker (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 13 mins 3.245 secs. FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py39:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 15m 17s 50 actionable tasks: 39 executed, 4 from cache, 7 up-to-date Publishing build scan... https://gradle.com/s/xphpisairfwvw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
