See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3982/display/redirect>
Changes:
------------------------------------------
[...truncated 215.40 KB...]
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for Saxon-HE-9.9.1-4: http://www.mozilla.org/MPL/2.0/.
Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={'User-Agent': 'Apache Beam'}))
File "/usr/lib/python3.7/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for javassist-3.27.0-GA:
http://www.mozilla.org/MPL/MPL-1.1.html. Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={'User-Agent': 'Apache Beam'}))
File "/usr/lib/python3.7/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for Saxon-HE-9.9.1-4: http://www.mozilla.org/MPL/2.0/
after 9 retries.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={'User-Agent': 'Apache Beam'}))
File "/usr/lib/python3.7/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for javassist-3.27.0-GA:
http://www.mozilla.org/MPL/MPL-1.1.html after 9 retries.
ERROR:root:['Saxon-HE-9.9.1-2', 'javassist-3.20.0-GA', 'Saxon-HE-9.9.1-4',
'javassist-3.27.0-GA']
ERROR:root:**************************************** Licenses were not able to
be pulled automatically for some dependencies. Please search source code of the
dependencies on the internet and add "license" and "notice" (if available)
field to
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
for each missing license. Dependency List:
[Saxon-HE-9.9.1-2,Saxon-HE-9.9.1-4,javassist-3.20.0-GA,javassist-3.27.0-GA]
INFO:root:pull_licenses_java.py failed. It took 86.487415 seconds with 16
threads.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 322, in <module>
error_msg)
RuntimeError: ('1 error(s) occurred.',
['**************************************** Licenses were not able to be pulled
automatically for some dependencies. Please search source code of the
dependencies on the internet and add "license" and "notice" (if available)
field to
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
for each missing license. Dependency List:
[Saxon-HE-9.9.1-2,Saxon-HE-9.9.1-4,javassist-3.20.0-GA,javassist-3.27.0-GA]'])
> Task :sdks:java:container:pullLicenses FAILED
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:python:container:py37:docker
Collecting tensorflow-estimator==2.9.0
Downloading tensorflow_estimator-2.9.0-py2.py3-none-any.whl (438 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 438.7/438.7 KB 18.9 MB/s eta 0:00:00
Collecting tensorflow-io-gcs-filesystem==0.26.0
Downloading
tensorflow_io_gcs_filesystem-0.26.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(2.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 79.6 MB/s eta 0:00:00
Collecting termcolor==1.1.0
Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting testcontainers==3.6.0
Downloading testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.3/41.3 KB 4.9 MB/s eta 0:00:00
Collecting threadpoolctl==3.1.0
Downloading threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting tqdm==4.64.0
Downloading tqdm-4.64.0-py2.py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.4/78.4 KB 9.8 MB/s eta 0:00:00
Collecting typing-utils==0.1.0
Downloading typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting typing_extensions==4.2.0
Downloading typing_extensions-4.2.0-py3-none-any.whl (24 kB)
Collecting uritemplate==4.1.1
Downloading uritemplate-4.1.1-py2.py3-none-any.whl (10 kB)
Collecting urllib3==1.26.9
Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.0/139.0 KB 17.3 MB/s eta 0:00:00
Collecting wcwidth==0.2.5
Downloading wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting websocket-client==1.3.2
Downloading websocket_client-1.3.2-py3-none-any.whl (54 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.3/54.3 KB 9.6 MB/s eta 0:00:00
Collecting Werkzeug==2.1.2
Downloading Werkzeug-2.1.2-py3-none-any.whl (224 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 224.9/224.9 KB 29.6 MB/s eta 0:00:00
Collecting wrapt==1.14.1
Downloading
wrapt-1.14.1-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(75 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.2/75.2 KB 10.2 MB/s eta 0:00:00
Collecting zipp==3.8.0
Downloading zipp-3.8.0-py3-none-any.whl (5.4 kB)
Building wheels for collected packages: atomicwrites, bs4, crcmod, dill,
docopt, future, google-apitools, google-cloud-profiler, termcolor
Building wheel for atomicwrites (setup.py): started
Building wheel for atomicwrites (setup.py): finished with status 'done'
Created wheel for atomicwrites:
filename=atomicwrites-1.4.1-py2.py3-none-any.whl size=6957
sha256=80ea6419fcd399fe2907b328207b3169361c837dd9c06a3ff8e70dcf29a07e71
Stored in directory:
/root/.cache/pip/wheels/0d/a9/a0/39edfadae620db443c05b5df0f6d5caad7411cf86b821790a6
Building wheel for bs4 (setup.py): started
Building wheel for bs4 (setup.py): finished with status 'done'
Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1272
sha256=5e81a8454cf2aaf85b9ff0a21cf0a45d486660e76dd734e0716b7117207aeeb6
Stored in directory:
/root/.cache/pip/wheels/0a/9e/ba/20e5bbc1afef3a491f0b3bb74d508f99403aabe76eda2167ca
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'done'
Created wheel for crcmod: filename=crcmod-1.7-cp37-cp37m-linux_x86_64.whl
size=30708
sha256=d8dc566bd91131c5939dcfae7fc2dfbcb1b383990cdddf8f25ce05f973a30369
Stored in directory:
/root/.cache/pip/wheels/dc/9a/e9/49e627353476cec8484343c4ab656f1e0d783ee77b9dde2d1f
Building wheel for dill (setup.py): started
Building wheel for dill (setup.py): finished with status 'done'
Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78544
sha256=d1e94156ddfd88e7257363d435c6bd011c5ac149429354b0897bd436dc72a790
Stored in directory:
/root/.cache/pip/wheels/a4/61/fd/c57e374e580aa78a45ed78d5859b3a44436af17e22ca53284f
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'done'
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl
size=13723
sha256=d4db6c920dc450714a4dae4cfa57739e16934b6df537f969cd41548dbe7eb212
Stored in directory:
/root/.cache/pip/wheels/72/b0/3f/1d95f96ff986c7dfffe46ce2be4062f38ebd04b506c77c81b9
Building wheel for future (setup.py): started
Building wheel for future (setup.py): finished with status 'done'
Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491070
sha256=fa2e991d77b458049deff9a786eb2623456fa641e4def334aee9f8330992513f
Stored in directory:
/root/.cache/pip/wheels/56/b0/fe/4410d17b32f1f0c3cf54cdfb2bc04d7b4b8f4ae377e2229ba0
Building wheel for google-apitools (setup.py): started
Building wheel for google-apitools (setup.py): finished with status 'done'
Created wheel for google-apitools:
filename=google_apitools-0.5.31-py3-none-any.whl size=131039
sha256=5e91ae0142bf1f3bbc3a0386045f4b64b560e1912c5504300e866c2fbdd0097f
Stored in directory:
/root/.cache/pip/wheels/19/b5/2f/1cc3cf2b31e7a9cd1508731212526d9550271274d351c96f16
Building wheel for google-cloud-profiler (setup.py): started
Building wheel for google-cloud-profiler (setup.py): finished with status
'done'
Created wheel for google-cloud-profiler:
filename=google_cloud_profiler-3.1.0-cp37-cp37m-linux_x86_64.whl size=736636
sha256=9d5baa091ce1e4d191353a6ddd3ecf73b4550e763a6ee3e321ca10925e4b51d1
Stored in directory:
/root/.cache/pip/wheels/72/11/1d/7daec504462a509bad012fce8b6b8b325a683bc81c1e6282b2
Building wheel for termcolor (setup.py): started
Building wheel for termcolor (setup.py): finished with status 'done'
Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl
size=4848
sha256=a5bf97905bf0f89807e0d6cb773633fb286584f85623c694f53bd76d170c7c0f
Stored in directory:
/root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2
Successfully built atomicwrites bs4 crcmod dill docopt future google-apitools
google-cloud-profiler termcolor
Installing collected packages: wcwidth, termcolor, tensorboard-plugin-wit,
tenacity, requests-mock, pytz, python-snappy, pytest-timeout, pyasn1-modules,
pyasn1, parameterized, oauth2client, nose, mock, mmh3, libclang,
Keras-Preprocessing, keras, hdfs, grpcio-gcp, google-python-cloud-debugger,
google-pasta, google-cloud-profiler, google-auth-httplib2, flatbuffers, docopt,
deprecation, crcmod, cffi, bs4, astunparse, zipp, wrapt, Werkzeug,
websocket-client, urllib3, uritemplate, typing-utils, typing_extensions, tqdm,
threadpoolctl, testcontainers, tensorflow-io-gcs-filesystem,
tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard,
SQLAlchemy, soupsieve, six, scipy, scikit-learn, rsa, requests-oauthlib,
requests, regex, PyYAML, python-dateutil, pytest-xdist, pytest-forked, pytest,
pyparsing, PyMySQL, pymongo, PyHamcrest, pydot, pycparser, pyarrow, py,
psycopg2-binary, protobuf, proto-plus, pluggy, pbr, pandas, packaging,
overrides, orjson, opt-einsum, oauthlib, numpy, nltk, more-itertools, Markdown,
joblib, importlib-metadata, idna, httplib2, h5py, guppy3, grpcio-status,
grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos,
google-resumable-media, google-crc32c, google-cloud-vision,
google-cloud-videointelligence, google-cloud-spanner,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-auth-oauthlib, google-auth, google-apitools,
google-api-python-client, google-api-core, gast, future, freezegun, fasteners,
fastavro, execnet, docker, dill, Cython, cryptography, cloudpickle, click,
charset-normalizer, certifi, cachetools, beautifulsoup4, attrs, atomicwrites,
absl-py
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 2507719.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 59s
258 actionable tasks: 168 executed, 78 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/xgvjvfaizzqpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
