See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/3157/display/redirect?page=changes>
Changes: [neville.lyh] [BEAM-10787] make external sorter 2048MB memory limit Hadoop only [sjvanrossum] Change imports of org.codehaus.jackson to com.fasterxml.jackson ------------------------------------------ [...truncated 488.41 KB...] Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 5 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2638 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24603 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container e72e8f86e0f6 ---> 29de21ce23d5 Step 6/23 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 9cb4c6e51f40 Step 7/23 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in fcf9d5d82c47 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment Ignoring futures: markers 'python_version < "3.0"' don't match your environment Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==1.0.0.post1 Downloading fastavro-1.0.0.post1-cp38-cp38-manylinux2014_x86_64.whl (1.7 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp38-cp38-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp38-cp38-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp38-cp38-manylinux2014_x86_64.whl (63.2 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Collecting typing-extensions==3.7.4.3 Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB) Collecting google-api-core==1.22.0 Downloading google_api_core-1.22.0-py2.py3-none-any.whl (91 kB) > Task :sdks:java:container:pullLicenses > Task :sdks:java:container:generateLicenseReport Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1m 40s 1 actionable task: 1 executed Publishing build scan... https://gradle.com/s/gepdigim7posu Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python3> Not overwriting existing python script <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> (you must use <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python3)> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Requirement already satisfied: beautifulsoup4<5.0,>=4.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (4.9.3) Requirement already satisfied: future<1.0.0,>=0.16.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20)) (0.18.2) Requirement already satisfied: pyyaml<6.0.0,>=3.12 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21)) (5.3.1) Requirement already satisfied: tenacity<6.0,>=5.0.2 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (5.1.5) Requirement already satisfied: soupsieve>1.2; python_version >= "3.0" in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (2.0.1) Requirement already satisfied: six>=1.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from tenacity<6.0,>=5.0.2->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (1.15.0) Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 180 dependencies using 16 threads. > Task :sdks:python:container:py38:docker FAILED Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.4.1 Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13.tar.gz (2.1 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9.tar.gz (333 kB) Collecting mmh3==2.5.1 Downloading mmh3-2.5.1.tar.gz (9.8 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp38-cp38-manylinux1_x86_64.whl (20.5 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp38-cp38-manylinux1_x86_64.whl (26.0 MB) Collecting pandas==0.25.2 Downloading pandas-0.25.2-cp38-cp38-manylinux1_x86_64.whl (10.4 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.3.0 Downloading tensorflow-2.3.0-cp38-cp38-manylinux2010_x86_64.whl (320.5 MB) [91mERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher yield File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 519, in read data = self._fp.read(amt) if not fp_closed else b"" File "/usr/local/lib/python3.8/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read data = self.__fp.read(amt) File "/usr/local/lib/python3.8/http/client.py", line 458, in read n = self.readinto(b) File "/usr/local/lib/python3.8/http/client.py", line 502, in readinto n = self.fp.readinto(b) File "/usr/local/lib/python3.8/socket.py", line 669, in readinto return self._sock.recv_into(b) File "/usr/local/lib/python3.8/ssl.py", line 1241, in recv_into return self.read(nbytes, buffer) File "/usr/local/lib/python3.8/ssl.py", line 1099, in read return self._sslobj.read(len, buffer) ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 228, in _main status = self.run(options, args) File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper return func(self, options, args) File "/usr/local/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 323, in run requirement_set = resolver.resolve( File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 183, in resolve discovered_reqs.extend(self._resolve_one(requirement_set, req)) File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 388, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 340, in _get_abstract_dist_for abstract_dist = self.preparer.prepare_linked_requirement(req) File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 467, in prepare_linked_requirement local_file = unpack_url( File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 255, in unpack_url file = get_http_url( File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 129, in get_http_url from_path, content_type = _download_http_url( File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 282, in _download_http_url for chunk in download.chunks: File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/progress_bars.py", line 168, in iter for x in it: File "/usr/local/lib/python3.8/site-packages/pip/_internal/network/utils.py", line 64, in response_chunks for chunk in response.raw.stream( File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream data = self.read(amt=amt, decode_content=decode_content) File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 541, in read raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File "/usr/local/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 455, in _error_catcher raise ProtocolError("Connection broken: %r" % e, e) pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt' returned a non-zero code: 2 > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 14.288783 seconds with 16 threads. Copy licenses to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:java:container:goBuild > Task :sdks:java:container:dockerPrepare > Task :sdks:java:container:docker > Task :runners:flink:1.10:job-server:flinkJobServerCleanup Stopping job server pid: 4387. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3m 6s 142 actionable tasks: 28 executed, 114 up-to-date Publishing build scan... https://gradle.com/s/oq6q2j3sijcrk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure No JDK named ‘JDK 1.8 (latest)’ found --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
