See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/197/display/redirect>
Changes: ------------------------------------------ [...truncated 59.06 KB...] Using cached cloudpickle-2.0.0-py3-none-any.whl (25 kB) Collecting fastavro<2,>=0.23.6 Using cached fastavro-1.4.10-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB) Requirement already satisfied: grpcio<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages> (from apache-beam==2.38.0.dev0) (1.44.0) Collecting hdfs<3.0.0,>=2.1.0 Using cached hdfs-2.6.0-py3-none-any.whl (33 kB) Collecting httplib2<0.20.0,>=0.8 Using cached httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting numpy<1.23.0,>=1.14.3 Using cached numpy-1.22.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB) Collecting pymongo<4.0.0,>=3.8.0 Using cached pymongo-3.12.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) Collecting oauth2client<5,>=2.0.1 Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages> (from apache-beam==2.38.0.dev0) (3.19.4) Collecting proto-plus<2,>=1.7.1 Using cached proto_plus-1.20.3-py3-none-any.whl (46 kB) Collecting pyarrow<7.0.0,>=0.15.1 Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB) Collecting pydot<2,>=1.2.0 Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB) Collecting python-dateutil<3,>=2.8.0 Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pytz>=2018.3 Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting requests<3.0.0,>=2.24.0 Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB) Collecting typing-extensions>=3.7.0 Using cached typing_extensions-4.1.1-py3-none-any.whl (26 kB) Collecting freezegun>=0.3.12 Using cached freezegun-1.2.1-py3-none-any.whl (16 kB) Collecting mock<3.0.0,>=1.0.1 Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting pandas<2.0.0 Using cached pandas-1.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB) Collecting parameterized<0.8.0,>=0.7.1 Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB) Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9 Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB) Collecting pyyaml<7.0.0,>=3.12 Using cached PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB) Collecting requests_mock<2.0,>=1.7 Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting pytest<5.0,>=4.4.0 Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB) Collecting pytest-xdist<2,>=1.29.0 Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB) Collecting pytest-timeout<2,>=1.3.3 Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB) Collecting sqlalchemy<2.0,>=1.3 Using cached SQLAlchemy-1.4.32-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) Collecting psycopg2-binary<3.0.0,>=2.8.5 Using cached psycopg2_binary-2.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB) Collecting testcontainers[mysql]<4.0.0,>=3.0.3 Using cached testcontainers-3.4.2-py2.py3-none-any.whl (31 kB) Collecting cryptography>=36.0.0 Using cached cryptography-36.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (3.6 MB) Collecting boto3>=1.9 Using cached boto3-1.21.22-py3-none-any.whl (132 kB) Collecting azure-storage-blob>=12.3.2 Using cached azure_storage_blob-12.10.0-py3-none-any.whl (346 kB) Collecting azure-core>=1.7.0 Using cached azure_core-1.23.0-py3-none-any.whl (179 kB) Collecting cachetools<5,>=3.1.0 Using cached cachetools-4.2.4-py3-none-any.whl (10 kB) Collecting google-apitools<0.5.32,>=0.5.31 Using cached google_apitools-0.5.31-py3-none-any.whl > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/python/container + chmod -R a+w /output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py39:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:python:container:py39:dockerPrepare > Task :sdks:python:container:py39:docker Sending build context to Docker daemon 16.43MB Step 1/31 : ARG py_version Step 2/31 : FROM python:"${py_version}"-bullseye as beam ---> 47abcf270bef Step 3/31 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in fb6b0d76a6c8 Removing intermediate container fb6b0d76a6c8 ---> 13ab28f286d5 Step 4/31 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* ---> Running in b7f9ae3d31db Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] Get:2 http://security.debian.org/debian-security bullseye-security InRelease [44.1 kB] Get:3 http://deb.debian.org/debian bullseye-updates InRelease [39.4 kB] Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB] Get:5 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [2596 B] Get:6 http://security.debian.org/debian-security bullseye-security/main amd64 Packages [121 kB] Fetched 8506 kB in 2s (3873 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.2-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded. Need to get 495 kB of archives. After this operation, 1425 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian bullseye/main amd64 ccache amd64 4.2-1 [446 kB] Get:2 http://deb.debian.org/debian bullseye/main amd64 libsnappy1v5 amd64 1.1.8-1 [17.9 kB] Get:3 http://deb.debian.org/debian bullseye/main amd64 libsnappy-dev amd64 1.1.8-1 [31.1 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 495 kB in 0s (5231 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 23373 files and directories currently installed.) Preparing to unpack .../ccache_4.2-1_amd64.deb ... Unpacking ccache (4.2-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.8-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.8-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.8-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.8-1) ... Setting up ccache (4.2-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.8-1) ... Setting up libsnappy-dev:amd64 (1.1.8-1) ... Processing triggers for libc-bin (2.31-13+deb11u2) ... Removing intermediate container b7f9ae3d31db ---> 8c8a179399a8 Step 5/31 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 048c8ea978a5 Step 6/31 : RUN pip install --no-deps -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in c6cac4421673 > Task :sdks:java:container:java8:docker Sending build context to Docker daemon 170.5MB Step 1/19 : ARG java_version Step 2/19 : FROM openjdk:${java_version}-bullseye ---> 89fd67087664 Step 3/19 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in 0b13a6287051 Removing intermediate container 0b13a6287051 ---> 195c294db4b9 Step 4/19 : ARG pull_licenses ---> Running in 3a24dc337007 Removing intermediate container 3a24dc337007 ---> ddc7955f267e Step 5/19 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> 69d1e7fa3616 Step 6/19 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> 1ac8f652273b Step 7/19 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> d5cd7d8bf7c6 Step 8/19 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> e9ca0ac15c66 Step 9/19 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 8fc3c9380cec Step 10/19 : ADD target/jamm.jar /opt/apache/beam/jars/ ---> 4ff8c78fb70e Step 11/19 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 10c8eda279f9 Step 12/19 : COPY target/LICENSE /opt/apache/beam/ ---> 69a52c279de2 Step 13/19 : COPY target/NOTICE /opt/apache/beam/ ---> 473178054422 Step 14/19 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> c616a229a9f8 Step 15/19 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 6d921d680144 Step 16/19 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in e66a0e88d5e1 Removing intermediate container e66a0e88d5e1 ---> e9b266409491 Step 17/19 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in c71250b6f420 Removing intermediate container c71250b6f420 ---> a34a71963e32 Step 18/19 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 46add5ae91d2 Step 19/19 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 6d9765be1fef Removing intermediate container 6d9765be1fef ---> 7ae6b9af7efd Successfully built 7ae6b9af7efd Successfully tagged apache/beam_java8_sdk:2.38.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :sdks:python:container:py39:docker The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1 > Task :sdks:python:container:py39:docker FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py39:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 11m 20s 147 actionable tasks: 99 executed, 42 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/jo4easgce5bfy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
