See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1168/display/redirect?page=changes>
Changes: [jx643] fixing the IOException handling [jiadaixia] change getErrorInfo into seperate method [jiadaixia] delete unused import [jiadaixia] delete empty line in import [jiadaixia] spotless change [jiadaixia] naming change [jiadaixia] change to vendored gauva class [jiadaixia] add unit test [jiadaixia] remove redundent code [jiadaixia] further simplifies getErrorInfo [jiadaixia] spotless fix [jiadaixia] update [jiadaixia] spotless [jiadaixia] add comment [jiadaixia] change test names [jiadaixia] spotless [jiadaixia] style change [jiadaixia] add failure [srohde] Add ElementLimiters which allows the cache to prematurely based on read [jiadaixia] change exception handling [jiadaixia] add jira issue [srohde] Remove start_secs parameter. [daniel.o.programmer] [BEAM-10289] Go Dynamic splitting full implementation. [daniel.o.programmer] [BEAM-10289] Avoiding blocking when dynamic splitting in Go. [Andrew Pilloud] [BEAM-10470] Handle null state from waitUntilFinish [noreply] Merge pull request #12203 from [BEAM-6928] Make Python SDK custom Sink [ningk] [BEAM-10635] Fix forward the google-api-core version [noreply] [BEAM-10618] subprocess_server.py: Fallback to AF_INET6 family when [noreply] [BEAM-10629] Added KnownBuilderInstances to ExternalTransformRegistrar [noreply] [BEAM-10637] fix: test stream service start/stop (#12464) ------------------------------------------ [...truncated 939.66 KB...] > Configure project :sdks:go:examples Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:test Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:python:container Found go 1.12 in /usr/bin/go, use it. > Task :sdks:python:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 UP-TO-DATE > Task :sdks:python:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:python:container:goBuild > Task :sdks:python:container:py35:copyLauncherDependencies > Task :sdks:python:sdist <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python3.5/site-packages/setuptools/distutils_patch.py>:26: UserWarning: Distutils was imported before Setuptools. This usage is discouraged and may exhibit undesirable behaviors or errors. Please use Setuptools' objects directly or at least import Setuptools first. "Distutils was imported before Setuptools. This usage is discouraged " <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python3.5/site-packages/setuptools/dist.py>:458: UserWarning: Normalizing '2.24.0.dev' to '2.24.0.dev0' warnings.warn(tmpl.format(**locals())) INFO:gen_protos:Skipping proto regeneration: all files up to date warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py35:copyDockerfileDependencies > Task :sdks:python:container:py35:dockerPrepare > Task :sdks:java:container:pullLicenses INFO:root:Pulling license for 176 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.52336 seconds with 16 threads. > Task :sdks:python:container:py35:docker Fetched 203 kB in 0s (2129 kB/s) > Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE > Task :sdks:python:installGcpTest Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.24.0.dev0-py3-none-any.whl size=2143076 sha256=3ad2d6dc47c60d3e58130be12e51cf2ca1fc7fe6621a4c836b2c5f46cba8177b Stored in directory: /home/jenkins/.cache/pip/wheels/8c/7a/56/fdea47f708d44db2432615d91d05531c528a5a6b13f986e6b1 Successfully built apache-beam > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:python:container:py35:docker Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24603 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... > Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:java:container:goBuild > Task :sdks:python:installGcpTest Installing collected packages: crcmod, dill, pytz, fastavro, docopt, certifi, urllib3, idna, chardet, requests, hdfs, httplib2, pbr, mock, numpy, pymongo, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, python-dateutil, typing-extensions, typing, pyarrow, avro-python3, docutils, jmespath, botocore, s3transfer, boto3, cachetools, monotonic, fasteners, google-apitools, google-auth, googleapis-common-protos, google-api-core, google-cloud-core, google-cloud-datastore, grpc-google-iam-v1, google-cloud-pubsub, pycparser, cffi, google-crc32c, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, google-cloud-spanner, grpcio-gcp, google-cloud-dlp, google-cloud-language, google-cloud-videointelligence, google-cloud-vision, freezegun, nose, nose-xunitmp, parameterized, pyhamcrest, pyyaml, requests-mock, tenacity, pathlib2, packaging, wcwidth, more-itertools, attrs, atomicwrites, pytest, pytest-forked, apipkg, execnet, pytest-xdist, pytest-timeout, sqlalchemy, psycopg2-binary, wrapt, deprecation, websocket-client, docker, blindspin, colorama, crayons, testcontainers, pandas, apache-beam > Task :sdks:java:container:dockerPrepare > Task :sdks:java:container:docker > Task :sdks:python:installGcpTest Successfully installed apache-beam-2.24.0.dev0 apipkg-1.5 atomicwrites-1.4.0 attrs-19.3.0 avro-python3-1.9.2.1 blindspin-2.0.1 boto3-1.14.35 botocore-1.17.35 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.1 chardet-3.0.4 colorama-0.4.3 crayons-0.3.1 crcmod-1.7 deprecation-2.1.0 dill-0.3.1.1 docker-4.2.2 docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.23.6 fasteners-0.15 freezegun-0.3.15 google-api-core-1.22.0 google-apitools-0.5.31 google-auth-1.20.0 google-cloud-bigquery-1.26.1 google-cloud-bigtable-1.4.0 google-cloud-core-1.4.0 google-cloud-datastore-1.13.2 google-cloud-dlp-1.0.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.7.0 google-cloud-spanner-1.17.1 google-cloud-videointelligence-1.15.0 google-cloud-vision-1.0.0 google-crc32c-0.1.0 google-resumable-media-0.7.0 googleapis-common-protos-1.52.0 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.17.4 idna-2.10 jmespath-0.10.0 mock-2.0.0 monotonic-1.5 more-itertools-8.4.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.18.5 oauth2client-3.0.0 packaging-20.4 pandas-0.24.2 parameterized-0.7.4 pathlib2-2.3.5 pbr-5.4.5 psycopg2-binary-2.8.5 pyarrow-0.17.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.11.0 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.3.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.1 pytz-2020.1 pyyaml-5.3.1 requests-2.24.0 requests-mock-1.8.0 rsa-4.6 s3transfer-0.3.3 sqlalchemy-1.3.18 tenacity-5.1.5 testcontainers-3.0.3 typing-3.7.4.3 typing-extensions-3.7.4.2 urllib3-1.25.10 wcwidth-0.2.5 websocket-client-0.57.0 wrapt-1.12.1 > Task :sdks:python:container:py35:docker Ignoring avro: markers 'python_version <= "2.7"' don't match your environment Ignoring futures: markers 'python_version < "3.0"' don't match your environment Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==0.23.3 Downloading fastavro-0.23.3-cp35-cp35m-manylinux2010_x86_64.whl (1.3 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp35-cp35m-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==3.0.0 Downloading oauth2client-3.0.0.tar.gz (77 kB) Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp35-cp35m-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp35-cp35m-manylinux2014_x86_64.whl (63.1 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB) Collecting google-api-core==1.21.0 Downloading google_api_core-1.21.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp35-cp35m-manylinux1_x86_64.whl (2.0 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9-cp35-cp35m-manylinux1_x86_64.whl (611 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp35-cp35m-manylinux1_x86_64.whl (19.8 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp35-cp35m-manylinux1_x86_64.whl (26.0 MB) Collecting pandas==0.25.2 Downloading pandas-0.25.2-cp35-cp35m-manylinux1_x86_64.whl (10.2 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.2.0 Downloading tensorflow-2.2.0-cp35-cp35m-manylinux2010_x86_64.whl (516.2 MB) [91mERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher yield File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 519, in read data = self._fp.read(amt) if not fp_closed else b"" File "/usr/local/lib/python3.5/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read data = self.__fp.read(amt) File "/usr/local/lib/python3.5/http/client.py", line 458, in read n = self.readinto(b) File "/usr/local/lib/python3.5/http/client.py", line 498, in readinto n = self.fp.readinto(b) File "/usr/local/lib/python3.5/socket.py", line 576, in readinto return self._sock.recv_into(b) File "/usr/local/lib/python3.5/ssl.py", line 937, in recv_into return self.read(nbytes, buffer) File "/usr/local/lib/python3.5/ssl.py", line 799, in read return self._sslobj.read(len, buffer) File "/usr/local/lib/python3.5/ssl.py", line 583, in read v = self._sslobj.read(len, buffer) ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/base_command.py", line 216, in _main status = self.run(options, args) File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper return func(self, options, args) File "/usr/local/lib/python3.5/site-packages/pip/_internal/commands/install.py", line 325, in run reqs, check_supported_wheels=not options.target_dir File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 183, in resolve discovered_reqs.extend(self._resolve_one(requirement_set, req)) File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 388, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/usr/local/lib/python3.5/site-packages/pip/_internal/resolution/legacy/resolver.py", line 340, in _get_abstract_dist_for abstract_dist = self.preparer.prepare_linked_requirement(req) File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 469, in prepare_linked_requirement hashes=self._get_linked_req_hashes(req) File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 259, in unpack_url hashes=hashes, File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 130, in get_http_url link, downloader, temp_dir.path, hashes File "/usr/local/lib/python3.5/site-packages/pip/_internal/operations/prepare.py", line 282, in _download_http_url for chunk in download.chunks: File "/usr/local/lib/python3.5/site-packages/pip/_internal/cli/progress_bars.py", line 168, in iter for x in it: File "/usr/local/lib/python3.5/site-packages/pip/_internal/network/utils.py", line 88, in response_chunks decode_content=False, File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream data = self.read(amt=amt, decode_content=decode_content) File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 541, in read raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File "/usr/local/lib/python3.5/contextlib.py", line 77, in __exit__ self.gen.throw(type, value, traceback) File "/usr/local/lib/python3.5/site-packages/pip/_vendor/urllib3/response.py", line 455, in _error_catcher raise ProtocolError("Connection broken: %r" % e, e) pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [0m[91mWARNING: You are using pip version 20.2; however, version 20.2.1 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 2 > Task :sdks:python:container:py35:docker FAILED > Task :runners:spark:job-server:sparkJobServerCleanup Stopping job server pid: 32150. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py35:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2m 16s 133 actionable tasks: 28 executed, 105 up-to-date Publishing build scan... https://gradle.com/s/kwn6bt5pnwh3e Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
