See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7037/display/redirect?page=changes>
Changes:
[Pablo Estrada] Updating BigQuery client for Python
[Andrew Pilloud] [BEAM-11165] ZetaSQL Calc only convert referenced columns
[Robin Qiu] Support read/write ZetaSQL DATETIME/NUMERIC types from/to BigQuery
[Robin Qiu] Address comments
[noreply] Merge pull request #13164 from Refactoring BigQuery Read utilities
into
[Robert Burke] Moving to 2.27.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 101.50 KB...]
Setting up ccache (3.6-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libsnappy-dev:amd64 (1.1.7-1) ...
Processing triggers for libc-bin (2.28-10) ...
Removing intermediate container ecd00b076a3f
---> afa42d3bc575
Step 6/23 : COPY target/base_image_requirements.txt
/tmp/base_image_requirements.txt
---> 336195694069
Step 7/23 : RUN pip install -r /tmp/base_image_requirements.txt &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._default_implementation_type == 'cpp'; print ('Verified fast
protobuf used.')" && rm -rf /root/.cache/pip && rm -rf
/tmp/base_image_requirements.txt
---> Running in d4bb553fba0a
Ignoring avro: markers 'python_version <= "2.7"' don't match your environment
Ignoring futures: markers 'python_version < "3.0"' don't match your environment
Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment
Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your
environment
Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment
Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment
Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment
Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment
Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your
environment
Collecting avro-python3==1.8.2
Downloading avro-python3-1.8.2.tar.gz (36 kB)
Collecting fastavro==1.0.0.post1
Downloading fastavro-1.0.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (1.4 MB)
Collecting crcmod==1.7
Downloading crcmod-1.7.tar.gz (89 kB)
Collecting dill==0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting future==0.18.2
Downloading future-0.18.2.tar.gz (829 kB)
Collecting grpcio==1.29.0
Downloading grpcio-1.29.0-cp36-cp36m-manylinux2010_x86_64.whl (3.0 MB)
Collecting hdfs==2.5.8
Downloading hdfs-2.5.8.tar.gz (41 kB)
Collecting httplib2==0.12.0
Downloading httplib2-0.12.0.tar.gz (218 kB)
Collecting mock==2.0.0
Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting oauth2client==4.1.3
Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting protobuf==3.12.2
Downloading protobuf-3.12.2-cp36-cp36m-manylinux1_x86_64.whl (1.3 MB)
Collecting pyarrow==0.16.0
Downloading pyarrow-0.16.0-cp36-cp36m-manylinux2014_x86_64.whl (63.1 MB)
Collecting pydot==1.4.1
Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting pymongo==3.9.0
Downloading pymongo-3.9.0-cp36-cp36m-manylinux1_x86_64.whl (446 kB)
Collecting pytz==2019.3
Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting pyyaml==5.1
Downloading PyYAML-5.1.tar.gz (274 kB)
Collecting typing-extensions==3.7.4.3
Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting google-api-core==1.22.0
Downloading google_api_core-1.22.0-py2.py3-none-any.whl (91 kB)
Collecting google-apitools==0.5.28
Downloading google-apitools-0.5.28.tar.gz (172 kB)
Collecting google-cloud-pubsub==1.0.2
Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery==1.26.1
Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB)
Collecting google-cloud-bigtable==1.0.0
Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-core==1.4.1
Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-datastore==1.7.4
Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting cython==0.29.13
Downloading Cython-0.29.13-cp36-cp36m-manylinux1_x86_64.whl (2.1 MB)
Collecting guppy3==3.0.9
Downloading guppy3-3.0.9-cp36-cp36m-manylinux1_x86_64.whl (612 kB)
Collecting mmh3==2.5.1
Downloading mmh3-2.5.1.tar.gz (9.8 kB)
Collecting numpy==1.17.3
Downloading numpy-1.17.3-cp36-cp36m-manylinux1_x86_64.whl (20.0 MB)
Collecting scipy==1.4.1
Downloading scipy-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (26.1 MB)
Collecting pandas==0.25.2
Downloading pandas-0.25.2-cp36-cp36m-manylinux1_x86_64.whl (10.4 MB)
Collecting protorpc==0.12.0
Downloading protorpc-0.12.0.tar.gz (117 kB)
Collecting python-gflags==3.0.6
Downloading python-gflags-3.0.6.tar.gz (49 kB)
Collecting tensorflow==2.3.0
Downloading tensorflow-2.3.0-cp36-cp36m-manylinux2010_x86_64.whl (320.4 MB)
Collecting tenacity>=5.0.2
Downloading tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting pyhamcrest<2.0,>=1.9
Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting nose==1.3.7
Downloading nose-1.3.7-py3-none-any.whl (154 kB)
Collecting six>=1.5.2
Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting docopt
Downloading docopt-0.6.2.tar.gz (25 kB)
Collecting requests>=2.7.0
Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting pbr>=0.11
Downloading pbr-5.5.1-py2.py3-none-any.whl (106 kB)
Collecting rsa>=3.1.4
Downloading rsa-4.6-py3-none-any.whl (47 kB)
Collecting pyasn1-modules>=0.0.5
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting pyasn1>=0.1.7
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Requirement already satisfied: setuptools in
/usr/local/lib/python3.6/site-packages (from protobuf==3.12.2->-r
/tmp/base_image_requirements.txt (line 38)) (50.3.2)
Collecting pyparsing>=2.1.4
Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting google-auth<2.0dev,>=1.19.1
Downloading google_auth-1.23.0-py2.py3-none-any.whl (114 kB)
Collecting fasteners>=0.14
Downloading fasteners-0.15-py2.py3-none-any.whl (23 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
Collecting google-resumable-media<2.0dev,>=0.5.0
Downloading google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB)
Collecting python-dateutil>=2.6.1
Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting tensorflow-estimator<2.4.0,>=2.3.0
Downloading tensorflow_estimator-2.3.0-py2.py3-none-any.whl (459 kB)
Collecting astunparse==1.6.3
Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting absl-py>=0.7.0
Downloading absl_py-0.11.0-py3-none-any.whl (127 kB)
Collecting termcolor>=1.1.0
Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting google-pasta>=0.1.8
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting keras-preprocessing<1.2,>=1.1.1
Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Collecting h5py<2.11.0,>=2.10.0
Downloading h5py-2.10.0-cp36-cp36m-manylinux1_x86_64.whl (2.9 MB)
Collecting tensorboard<3,>=2.3.0
Downloading tensorboard-2.3.0-py3-none-any.whl (6.8 MB)
Collecting wrapt>=1.11.1
Downloading wrapt-1.12.1.tar.gz (27 kB)
Requirement already satisfied: wheel>=0.26 in
/usr/local/lib/python3.6/site-packages (from tensorflow==2.3.0->-r
/tmp/base_image_requirements.txt (line 73)) (0.35.1)
Collecting gast==0.3.3
Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting certifi>=2017.4.17
Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting chardet<4,>=3.0.2
Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting idna<3,>=2.5
Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Downloading urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting cachetools<5.0,>=2.0.0
Downloading cachetools-4.1.1-py3-none-any.whl (10 kB)
Collecting monotonic>=0.1
Downloading monotonic-1.5-py2.py3-none-any.whl (5.3 kB)
Collecting google-crc32c<2.0dev,>=1.0; python_version >= "3.5"
Downloading google_crc32c-1.0.0-cp36-cp36m-manylinux2010_x86_64.whl (39 kB)
Collecting tensorboard-plugin-wit>=1.6.0
Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB)
Collecting markdown>=2.6.8
Downloading Markdown-3.3.3-py3-none-any.whl (96 kB)
Collecting werkzeug>=0.11.15
Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
[91mERROR: Exception:
Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/urllib3/response.py", line
437, in _error_catcher
yield
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/urllib3/response.py", line
519, in read
data = self._fp.read(amt) if not fp_closed else b""
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/cachecontrol/filewrapper.py",
line 62, in read
data = self.__fp.read(amt)
File "/usr/local/lib/python3.6/http/client.py", line 463, in read
n = self.readinto(b)
File "/usr/local/lib/python3.6/http/client.py", line 507, in readinto
n = self.fp.readinto(b)
File "/usr/local/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
File "/usr/local/lib/python3.6/ssl.py", line 1012, in recv_into
return self.read(nbytes, buffer)
File "/usr/local/lib/python3.6/ssl.py", line 874, in read
return self._sslobj.read(len, buffer)
File "/usr/local/lib/python3.6/ssl.py", line 631, in read
v = self._sslobj.read(len, buffer)
ConnectionResetError: [Errno 104] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/cli/base_command.py",
line 228, in _main
status = self.run(options, args)
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/cli/req_command.py", line
182, in wrapper
return func(self, options, args)
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/commands/install.py",
line 324, in run
reqs, check_supported_wheels=not options.target_dir
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/legacy/resolver.py",
line 183, in resolve
discovered_reqs.extend(self._resolve_one(requirement_set, req))
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/legacy/resolver.py",
line 388, in _resolve_one
abstract_dist = self._get_abstract_dist_for(req_to_install)
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/legacy/resolver.py",
line 340, in _get_abstract_dist_for
abstract_dist = self.preparer.prepare_linked_requirement(req)
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py",
line 469, in prepare_linked_requirement
hashes=self._get_linked_req_hashes(req)
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py",
line 259, in unpack_url
hashes=hashes,
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py",
line 130, in get_http_url
link, downloader, temp_dir.path, hashes
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py",
line 282, in _download_http_url
for chunk in download.chunks:
File
"/usr/local/lib/python3.6/site-packages/pip/_internal/cli/progress_bars.py",
line 168, in iter
for x in it:
File "/usr/local/lib/python3.6/site-packages/pip/_internal/network/utils.py",
line 88, in response_chunks
decode_content=False,
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/urllib3/response.py", line
576, in stream
data = self.read(amt=amt, decode_content=decode_content)
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/urllib3/response.py", line
541, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
File "/usr/local/lib/python3.6/contextlib.py", line 99, in __exit__
self.gen.throw(type, value, traceback)
File
"/usr/local/lib/python3.6/site-packages/pip/_vendor/urllib3/response.py", line
455, in _error_catcher
raise ProtocolError("Connection broken: %r" % e, e)
pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken:
ConnectionResetError(104, 'Connection reset by peer')",
ConnectionResetError(104, 'Connection reset by peer'))
[0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._default_implementation_type == 'cpp'; print ('Verified fast
protobuf used.')" && rm -rf /root/.cache/pip && rm -rf
/tmp/base_image_requirements.txt' returned a non-zero code: 2
> Task :sdks:python:container:py36:docker FAILED
:sdks:python:container:py36:docker (Thread[Execution worker for ':' Thread
8,5,main]) completed. Took 2 mins 51.131 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py36:docker'.
> Process 'command 'docker'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 16s
20 actionable tasks: 19 executed, 1 up-to-date
Publishing build scan...
https://gradle.com/s/4tmzlzoikhh5i
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
