See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1222/display/redirect?page=changes>
Changes: [tobiasz.kedzierski] Improve CI documentation ------------------------------------------ [...truncated 946.85 KB...] Collecting importlib-resources>=1.0; python_version < "3.7" Using cached importlib_resources-3.0.0-py2.py3-none-any.whl (23 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Collecting zipp>=0.5 Using cached zipp-1.2.0-py2.py3-none-any.whl (4.8 kB) Installing collected packages: filelock, zipp, importlib-metadata, distlib, importlib-resources, six, appdirs, virtualenv, toml, pluggy, py, tox, protobuf, grpcio, grpcio-tools, future, mypy-protobuf Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.31.0 grpcio-tools-1.30.0 importlib-metadata-1.7.0 importlib-resources-3.0.0 mypy-protobuf-1.18 pluggy-0.13.1 protobuf-3.13.0 py-1.9.0 six-1.15.0 toml-0.10.1 tox-3.11.1 virtualenv-20.0.31 zipp-1.2.0 > Task :sdks:java:container:pullLicenses > Task :buildSrc:compileGroovy > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy > Task :buildSrc:spotlessGroovyCheck > Task :buildSrc:spotlessGroovyGradle > Task :buildSrc:spotlessGroovyGradleCheck > Task :buildSrc:spotlessCheck > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties > Task :buildSrc:check > Task :buildSrc:build Configuration on demand is an incubating feature. > Configure project :sdks:java:container Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:container Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:examples Found go 1.12 in /usr/bin/go, use it. > Task :sdks:python:sdist setup.py:271: UserWarning: You are using the final Apache Beam release with Python 3.5 support. New releases of Apache Beam will require Python 3.6 or a newer version. 'You are using the final Apache Beam release with Python 3.5 support. ' <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python3.5/site-packages/setuptools/dist.py>:458: UserWarning: Normalizing '2.25.0.dev' to '2.25.0.dev0' warnings.warn(tmpl.format(**locals())) INFO:gen_protos:Skipping proto regeneration: all files up to date warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py35:copyDockerfileDependencies > Task :sdks:python:container:py35:dockerPrepare > Task :sdks:java:container:pullLicenses > Configure project :sdks:go:test Found go 1.12 in /usr/bin/go, use it. INFO:root:Pulling license for 176 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.512727 seconds with 16 threads. > Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE > Task :sdks:python:container:py35:docker Processing triggers for libc-bin (2.28-10) ... > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:java:container:goBuild > Task :sdks:java:container:dockerPrepare > Task :sdks:python:installGcpTest > Task :sdks:java:container:docker ---> 4e1f595ad83d Step 8/12 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> e63a39f33c69 Step 9/12 : COPY target/LICENSE /opt/apache/beam/ ---> d788371d2bec Step 10/12 : COPY target/NOTICE /opt/apache/beam/ ---> 026ab4f5dc35 Step 11/12 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> aa10156e9635 Step 12/12 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 1f35b1adfded Removing intermediate container 1f35b1adfded ---> 0951355b3a13 Successfully built 0951355b3a13 Successfully tagged apache/beam_java_sdk:2.25.0.dev > Task :sdks:python:container:py35:docker Ignoring avro: markers 'python_version <= "2.7"' don't match your environment Ignoring futures: markers 'python_version < "3.0"' don't match your environment Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==0.23.3 Downloading fastavro-0.23.3-cp35-cp35m-manylinux2010_x86_64.whl (1.3 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp35-cp35m-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==3.0.0 Downloading oauth2client-3.0.0.tar.gz (77 kB) Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp35-cp35m-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp35-cp35m-manylinux2014_x86_64.whl (63.1 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB) Collecting google-api-core==1.21.0 Downloading google_api_core-1.21.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp35-cp35m-manylinux1_x86_64.whl (2.0 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9-cp35-cp35m-manylinux1_x86_64.whl (611 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp35-cp35m-manylinux1_x86_64.whl (19.8 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp35-cp35m-manylinux1_x86_64.whl (26.0 MB) [91mERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher yield File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 519, in read data = self._fp.read(amt) if not fp_closed else b"" File "/usr/local/lib/python3.5/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read data = self.__fp.read(amt) File "/usr/local/lib/python3.5/http/client.py", line 458, in read n = self.readinto(b) File "/usr/local/lib/python3.5/http/client.py", line 498, in readinto n = self.fp.readinto(b) File "/usr/local/lib/python3.5/socket.py", line 576, in readinto return self._sock.recv_into(b) File "/usr/local/lib/python3.5/ssl.py", line 937, in recv_into return self.read(nbytes, buffer) File "/usr/local/lib/python3.5/ssl.py", line 799, in read return self._sslobj.read(len, buffer) File "/usr/local/lib/python3.5/ssl.py", line 583, in read v = self._sslobj.read(len, buffer) ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/base_command.py", line 216, in _main status = self.run(options, args) File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper return func(self, options, args) File "/usr/local/lib/python3.5/site-packages/pip/_internal/commands/install.py", line 325, in run reqs, check_supported_wheels=not options.target_dir File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 183, in resolve discovered_reqs.extend(self._resolve_one(requirement_set, req)) File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 388, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 340, in _get_abstract_dist_for abstract_dist = self.preparer.prepare_linked_requirement(req) File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 469, in prepare_linked_requirement hashes=self._get_linked_req_hashes(req) File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 259, in unpack_url hashes=hashes, File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 130, in get_http_url link, downloader, temp_dir.path, hashes File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 282, in _download_http_url for chunk in download.chunks: File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/progress_bars.py", line 168, in iter for x in it: File "/usr/local/lib/python3.5/site-packages/pip/_internal/network/utils.py", line 88, in response_chunks decode_content=False, File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream data = self.read(amt=amt, decode_content=decode_content) File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 541, in read raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File "/usr/local/lib/python3.5/contextlib.py", line 77, in __exit__ self.gen.throw(type, value, traceback) File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 455, in _error_catcher raise ProtocolError("Connection broken: %r" % e, e) pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 2 > Task :sdks:python:container:py35:docker FAILED > Task :runners:spark:job-server:sparkJobServerCleanup Stopping job server pid: 12426. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py35:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 40s 133 actionable tasks: 28 executed, 105 up-to-date Publishing build scan... https://gradle.com/s/npmzzv5z4s5qm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
