See
<https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Cron/551/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-9956] Remove unbalanced code markup.
[zyichi] Bump up advanceProcessingTime duration in ParDoTest
[tobiasz.kedzierski] [BEAM-10623] Add workflow to run python tests on
Linux/Windows/Mac
[tobiasz.kedzierski] [BEAM-10624] dtype explicit for the numpy arrays
[Steve Niemitz] [BEAM-10523] Add support for custom DatumWriters to AvroIO.Write
[Luke Cwik] [BEAM-10040, BEAM-6804] Increase wait times to reduce flakiness.
[noreply] [BEAM-10752] add use_deprecated_read experiment for testSimpleInsert,
------------------------------------------
[...truncated 2.73 MB...]
PyHamcrest==1.10.1
pymongo==3.9.0
pyparsing==2.4.7
python-dateutil==2.8.1
python-gflags==3.0.6
pytz==2019.3
PyYAML==5.1
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.6
scipy==1.4.1
setuptools==49.6.0
six==1.15.0
tenacity==6.2.0
tensorboard==2.2.2
tensorboard-plugin-wit==1.7.0
tensorflow==2.2.0
tensorflow-estimator==2.2.0
termcolor==1.1.0
typing-extensions==3.7.4.1
urllib3==1.25.10
Werkzeug==1.0.1
wheel==0.35.1
wrapt==1.12.1
zipp==3.1.0
Removing intermediate container 352871d27e27
---> 44c42236860b
Step 15/18 : COPY target/LICENSE /opt/apache/beam/
---> e31f4e175fef
Step 16/18 : COPY target/NOTICE /opt/apache/beam/
---> 734f000a6e88
Step 17/18 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> e5c34001ab3d
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 012ef3142810
Removing intermediate container 012ef3142810
---> 00a2a1cd8489
Successfully built 00a2a1cd8489
Successfully tagged apache/beam_python3.6_sdk:2.25.0.dev
:sdks:python:container:py36:docker (Thread[Execution worker for ':' Thread
5,5,main]) completed. Took 12 mins 18.616 secs.
> Task :sdks:python:container:py38:docker
Removing intermediate container d61e83e04fda
---> b99a0a6b56c2
Step 12/18 : COPY target/license_scripts /tmp/license_scripts/
---> 612e0bc22f77
Step 13/18 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<3.0.0;python_version>="3.5"' && pip install
'pip-licenses==1.18.0;python_version<="2.7"' && python
/tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses
&& rm -rf /root/.cache/pip ; fi
---> Running in d5b21e119ba1
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22907
sha256=c2eac0e08479fc4b9984dd245a8708afd9b2acae7135221358698591cbd7f376
Stored in directory:
/root/.cache/pip/wheels/1b/3a/02/8d8da2bca2223dda2f827949c88b2d82dc85dccbc2bb6265e5
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
Ignoring pip-licenses: markers 'python_version <= "2.7"' don't match your
environment
Skip pulling license for apache-beam
[91mINFO:root:Successfully pulled licenses for 82 dependencies
[0mFound existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
Removing intermediate container d5b21e119ba1
---> 6ba552a48eaf
Step 14/18 : RUN pip freeze --all
---> Running in b15736fd0806
absl-py==0.9.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
avro-python3==1.8.2
cachetools==3.1.1
certifi==2020.6.20
cffi==1.14.2
chardet==3.0.4
crcmod==1.7
Cython==0.29.13
dill==0.3.1.1
docopt==0.6.2
fastavro==0.23.3
fasteners==0.15
future==0.18.2
gast==0.3.3
google-api-core==1.21.0
google-apitools==0.5.31
google-auth==1.20.1
google-auth-oauthlib==0.4.1
google-cloud-bigquery==1.26.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.1.0
google-cloud-datastore==1.7.4
google-cloud-dlp==1.0.0
google-cloud-language==1.3.0
google-cloud-pubsub==1.0.2
google-cloud-spanner==1.17.1
google-cloud-videointelligence==1.15.0
google-cloud-vision==1.0.0
google-crc32c==0.1.0
google-pasta==0.2.0
google-resumable-media==0.7.1
googleapis-common-protos==1.52.0
grpc-google-iam-v1==0.12.3
grpcio==1.29.0
grpcio-gcp==0.2.2
guppy3==3.0.9
h5py==2.10.0
hdfs==2.5.8
httplib2==0.12.0
idna==2.10
Keras-Preprocessing==1.1.2
Markdown==3.2.2
mock==2.0.0
monotonic==1.5
nose==1.3.7
numpy==1.17.3
oauth2client==3.0.0
oauthlib==3.1.0
opt-einsum==3.3.0
pandas==0.25.2
pbr==5.4.5
pip==20.2.2
protobuf==3.12.2
protorpc==0.12.0
PTable==0.9.2
pyarrow==0.16.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.20
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.9.0
pyparsing==2.4.7
python-dateutil==2.8.1
python-gflags==3.0.6
pytz==2019.3
PyYAML==5.1
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.6
scipy==1.4.1
setuptools==49.3.1
six==1.15.0
tenacity==6.2.0
tensorboard==2.2.2
tensorboard-plugin-wit==1.7.0
tensorflow==2.2.0
tensorflow-estimator==2.2.0
termcolor==1.1.0
typing-extensions==3.7.4.1
urllib3==1.25.10
Werkzeug==1.0.1
wheel==0.34.2
wrapt==1.12.1
Removing intermediate container b15736fd0806
---> 5994fc0deace
Step 15/18 : COPY target/LICENSE /opt/apache/beam/
---> 19e8d3bf6931
Step 16/18 : COPY target/NOTICE /opt/apache/beam/
---> fe516a8d7b06
Step 17/18 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> e327dffbd3d0
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4a9ec778ad62
Removing intermediate container 4a9ec778ad62
---> e9e1d01d51f8
Successfully built e9e1d01d51f8
Successfully tagged apache/beam_python3.8_sdk:2.25.0.dev
:sdks:python:container:py38:docker (Thread[Execution worker for ':' Thread
10,5,main]) completed. Took 12 mins 21.349 secs.
> Task :sdks:python:container:py2:docker
[91mERROR:root:Error occurred when pull license for enum34 from {'license':
'https://bitbucket.org/stoneleaf/enum34/raw/c208549a93b71b948ff7bbdfd29dce8f85527916/enum/LICENSE'}.
Traceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 94, in pull_from_url
url_read = urlopen(config['license'])
File "/usr/local/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/usr/local/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/local/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/local/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/local/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/local/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 403: Forbidden
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 133, in <module>
pull_from_url(dep['Name'].lower(), dep_config['pip_dependencies'])):
File "/usr/local/lib/python2.7/site-packages/tenacity/__init__.py", line 329,
in wrapped_f
return self.call(f, *args, **kw)
File "/usr/local/lib/python2.7/site-packages/tenacity/__init__.py", line 409,
in call
[0m('Skip pulling license for ', u'apache-beam')
[91m do = self.iter(retry_state=retry_state)
File "/usr/local/lib/python2.7/site-packages/tenacity/__init__.py", line 368,
in iter
[0m[91m raise retry_exc.reraise()
File "/usr/local/lib/python2.7/site-packages/tenacity/__init__.py", line 186,
in reraise
raise self.last_attempt.result()
File "/usr/local/lib/python2.7/site-packages/concurrent/futures/_base.py",
line 455, in result
[0m[91m return self.__get_result()
File "/usr/local/lib/python2.7/site-packages/tenacity/__init__.py", line 412,
in call
result = fn(*args, **kwargs)
File "/tmp/license_scripts/pull_licenses_py.py", line 94, in pull_from_url
[0m[91m url_read = urlopen(config['license'])
File "/usr/local/lib/python2.7/urllib2.py", line 154, in urlopen
[0m[91m return opener.open(url, data, timeout)
File "/usr/local/lib/python2.7/urllib2.py", line 435, in open
[0m[91m response = meth(req, response)
File "/usr/local/lib/python2.7/urllib2.py", line 548, in http_response
[0m[91m 'http', request, response, code, msg, hdrs)
File "/usr/local/lib/python2.7/urllib2.py", line 473, in error
[0m[91m return self._call_chain(*args)
File "/usr/local/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/local/lib/python2.7/urllib2.py", line 556, in http_error_default
[0m[91m raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 403: Forbidden
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip
install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install
'pip-licenses==1.18.0;python_version<="2.7"' && python
/tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses
&& rm -rf /root/.cache/pip ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py2:docker FAILED
:sdks:python:container:py2:docker (Thread[Execution worker for ':' Thread
3,5,main]) completed. Took 12 mins 28.361 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py2:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 15m 26s
48 actionable tasks: 43 executed, 5 up-to-date
Publishing build scan...
https://gradle.com/s/nskw2ougsdrpw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
