See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1473/display/redirect>
Changes: ------------------------------------------ [...truncated 446.77 KB...] > Configure project :sdks:go Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:container Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:examples Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:test Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:python:container Found go 1.12 in /usr/bin/go, use it. > Task :sdks:java:container:generateLicenseReport Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 20s 1 actionable task: 1 executed Publishing build scan... https://gradle.com/s/vquktvsbg3doi Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python3> Not overwriting existing python script <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> (you must use <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python3)> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Requirement already satisfied: beautifulsoup4<5.0,>=4.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (4.9.3) Requirement already satisfied: future<1.0.0,>=0.16.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20)) (0.18.2) Requirement already satisfied: pyyaml<6.0.0,>=3.12 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21)) (5.3.1) Requirement already satisfied: tenacity<6.0,>=5.0.2 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (5.1.5) Requirement already satisfied: soupsieve>1.2; python_version >= "3.0" in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (2.0.1) Requirement already satisfied: six>=1.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from tenacity<6.0,>=5.0.2->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (1.15.0) Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 180 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.999722 seconds with 16 threads. Copy licenses to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:python:container:py38:docker Sending build context to Docker daemon 38.03MB Step 1/23 : ARG py_version Step 2/23 : FROM python:"${py_version}"-buster 3.8-buster: Pulling from library/python Digest: sha256:8f4fc98cddde0c0618c6abccb54de52a25485b60bd5a3acc30c2c55ae732237f Status: Downloaded newer image for python:3.8-buster ---> a52c041f5098 Step 3/23 : MAINTAINER "Apache Beam <d...@beam.apache.org>" ---> Running in 01a3f7dfe6a2 Removing intermediate container 01a3f7dfe6a2 ---> f946aa78c5a4 Step 4/23 : ARG pull_licenses ---> Running in 1dfdde4498bc Removing intermediate container 1dfdde4498bc ---> 7c97372e7cc3 Step 5/23 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* ---> Running in ba862d8a9b68 Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB] Get:2 http://deb.debian.org/debian buster InRelease [121 kB] Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB] Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [239 kB] Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [7868 B] Fetched 8392 kB in 2s (4012 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2340 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24603 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container ba862d8a9b68 ---> 6082730ab2d4 Step 6/23 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> cc659b243d8b Step 7/23 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in 7cdb9e7d2ec2 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment Ignoring futures: markers 'python_version < "3.0"' don't match your environment Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==1.0.0.post1 Downloading fastavro-1.0.0.post1-cp38-cp38-manylinux2014_x86_64.whl (1.7 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) > Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:python:container:py38:docker Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp38-cp38-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:java:container:goBuild > Task :sdks:python:container:py38:docker Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp38-cp38-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp38-cp38-manylinux2014_x86_64.whl (63.2 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Collecting typing-extensions==3.7.4.3 Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB) Collecting google-api-core==1.22.0 Downloading google_api_core-1.22.0-py2.py3-none-any.whl (91 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.4.1 Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) > Task :sdks:java:container:dockerPrepare > Task :sdks:python:container:py38:docker FAILED The command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt' returned a non-zero code: 2 > Task :sdks:java:container:docker ---> 158f65bbe04c Step 8/17 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> 7570422efb69 Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 1148efd92890 Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 5976a12b7dad Step 11/17 : COPY target/LICENSE /opt/apache/beam/ ---> daedcf6562f2 Step 12/17 : COPY target/NOTICE /opt/apache/beam/ ---> d54c1687a1a8 Step 13/17 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 6d2626c3854f Step 14/17 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 97ba4f7023f0 Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 2b5ab442fb6f Removing intermediate container 2b5ab442fb6f ---> 0d334df7eaf5 Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in ef440fa74028 Removing intermediate container ef440fa74028 ---> 3c9f719dab97 Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in a6b54677043f Removing intermediate container a6b54677043f ---> 03d57cf10592 Successfully built 03d57cf10592 Successfully tagged apache/beam_java8_sdk:2.26.0.dev > Task :runners:spark:job-server:sparkJobServerCleanup Stopping job server pid: 16984. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 7s 135 actionable tasks: 28 executed, 107 up-to-date Publishing build scan... https://gradle.com/s/dhegewue4nlao Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure No JDK named ‘JDK 1.8 (latest)’ found --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org