See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1294/display/redirect?page=changes>
Changes:
[noreply] [Go SDK] add retries to connect with expansion service (#25237)
[noreply] SpannerIO: parameterizing partitionQuery timeout (#25236)
[noreply] Use example id as CloudPath (#25487)
[noreply] SpannerIO: Handling pg spanner.commit_timestamp (#25479)
[noreply] Fix provider to be found by AutoService (#25491)
[noreply] [Python] Added Tensorflow Model Handler (#25368)
------------------------------------------
[...truncated 366.07 KB...]
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-quickcheck-generators-1.0:
http://www.opensource.org/licenses/mit-license.php after 9 retries.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for slf4j-api-1.7.35:
http://www.opensource.org/licenses/mit-license.php after 9 retries.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for log4j-over-slf4j-1.7.30:
http://www.opensource.org/licenses/mit-license.php after 9 retries.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(Request(url, headers={
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for slf4j-simple-1.7.30:
http://www.opensource.org/licenses/mit-license.php after 9 retries.
ERROR:root:['reflectasm-1.07', 'kryo-2.21', 'junit-quickcheck-core-1.0',
'software-and-algorithms-1.0', 'slf4j-api-1.7.30', 'pcollections-2.1.2',
'slf4j-jdk14-1.7.30', 'jcl-over-slf4j-1.7.30', 'minlog-1.2',
'junit-quickcheck-generators-1.0', 'slf4j-api-1.7.35',
'log4j-over-slf4j-1.7.30', 'slf4j-simple-1.7.30']
ERROR:root:**************************************** Licenses were not able to
be pulled automatically for some dependencies. Please search source code of the
dependencies on the internet and add "license" and "notice" (if available)
field to
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
for each missing license. Dependency List:
[jcl-over-slf4j-1.7.30,junit-quickcheck-core-1.0,junit-quickcheck-generators-1.0,kryo-2.21,log4j-over-slf4j-1.7.30,minlog-1.2,pcollections-2.1.2,reflectasm-1.07,slf4j-api-1.7.30,slf4j-api-1.7.35,slf4j-jdk14-1.7.30,slf4j-simple-1.7.30,software-and-algorithms-1.0]
INFO:root:pull_licenses_java.py failed. It took 90.758201 seconds with 16
threads.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 326, in <module>
raise RuntimeError('{n} error(s) occurred.'.format(n=len(error_msg)),
RuntimeError: ('1 error(s) occurred.',
['**************************************** Licenses were not able to be pulled
automatically for some dependencies. Please search source code of the
dependencies on the internet and add "license" and "notice" (if available)
field to
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
for each missing license. Dependency List:
[jcl-over-slf4j-1.7.30,junit-quickcheck-core-1.0,junit-quickcheck-generators-1.0,kryo-2.21,log4j-over-slf4j-1.7.30,minlog-1.2,pcollections-2.1.2,reflectasm-1.07,slf4j-api-1.7.30,slf4j-api-1.7.35,slf4j-jdk14-1.7.30,slf4j-simple-1.7.30,software-and-algorithms-1.0]'])
> Task :sdks:java:container:pullLicenses FAILED
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:go:container:docker
Reading state information...
The following additional packages will be installed:
openssl
The following NEW packages will be installed:
ca-certificates openssl
0 upgraded, 2 newly installed, 0 to remove and 1 not upgraded.
Need to get 1011 kB of archives.
After this operation, 1892 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian-security bullseye-security/main amd64
openssl amd64 1.1.1n-0+deb11u4 [853 kB]
Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all
20210119 [158 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0m
> Task :sdks:python:installGcpTest
Successfully installed PyJWT-2.6.0 apache-beam-2.46.0.dev0 attrs-22.2.0
azure-core-1.26.3 azure-identity-1.12.0 azure-storage-blob-12.14.1
boto3-1.26.71 botocore-1.29.71 cachetools-4.2.4 certifi-2022.12.7 cffi-1.15.1
charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.1
deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0
execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2
google-api-core-2.11.0 google-apitools-0.5.31 google-auth-2.16.0
google-auth-httplib2-0.1.0 google-cloud-bigquery-3.5.0
google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3
google-cloud-core-2.3.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.11.1
google-cloud-language-1.3.2 google-cloud-pubsub-2.14.1
google-cloud-pubsublite-1.7.0 google-cloud-recommendations-ai-0.7.1
google-cloud-spanner-3.27.1 google-cloud-videointelligence-1.16.3
google-cloud-vision-3.3.1 google-crc32c-1.5.0 google-resumable-media-2.4.1
googleapis-common-protos-1.58.0 greenlet-2.0.2 grpc-google-iam-v1-0.12.6
grpcio-status-1.48.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.68.1 idna-3.4
iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.2.0 mock-2.0.0
msal-1.21.0 msal-extensions-1.0.0 msrest-0.7.1 oauth2client-4.1.3
oauthlib-3.2.2 objsize-0.6.1 orjson-3.8.6 overrides-6.5.0 pandas-1.5.3
parameterized-0.8.1 pbr-5.11.1 portalocker-2.7.0 proto-plus-1.22.2
psycopg2-binary-2.9.5 pyarrow-9.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8
pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2
pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.6.0 pytest-timeout-2.1.0
pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0
regex-2022.10.31 requests-2.28.2 requests-oauthlib-1.3.1 requests_mock-1.10.0
rsa-4.9 s3transfer-0.6.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0
sqlalchemy-1.4.46 sqlparse-0.4.3 tenacity-5.1.5 testcontainers-3.7.1
threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.5.0 urllib3-1.26.14
websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.19.3 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
> Task :sdks:python:container:py38:docker
Collecting pymongo==3.13.0
Downloading
pymongo-3.13.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (526 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 526.2/526.2 KB 26.8 MB/s eta 0:00:00
Collecting PyMySQL==1.0.2
Downloading PyMySQL-1.0.2-py3-none-any.whl (43 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.8/43.8 KB 4.2 MB/s eta 0:00:00
Collecting pyparsing==3.0.9
Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.3/98.3 KB 10.4 MB/s eta 0:00:00
Collecting pytest==7.2.1
Downloading pytest-7.2.1-py3-none-any.whl (317 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 317.1/317.1 KB 23.5 MB/s eta 0:00:00
Collecting pytest-forked==1.4.0
Downloading pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting pytest-timeout==2.1.0
Downloading pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting pytest-xdist==2.5.0
Downloading pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 KB 3.1 MB/s eta 0:00:00
Collecting python-dateutil==2.8.2
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 25.2 MB/s eta 0:00:00
Collecting python-snappy==0.6.1
Downloading
python_snappy-0.6.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(56 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.1/56.1 KB 7.1 MB/s eta 0:00:00
Collecting pytz==2022.7.1
Downloading pytz-2022.7.1-py2.py3-none-any.whl (499 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 499.4/499.4 KB 34.1 MB/s eta 0:00:00
Collecting PyYAML==6.0
Downloading
PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(701 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 701.2/701.2 KB 42.1 MB/s eta 0:00:00
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :sdks:go:container:docker
Fetched 1011 kB in 0s (3934 kB/s)
Selecting previously unselected package openssl.
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading
database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading
database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading
database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading
database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading
database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading
database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading
database ... 6661 files and directories currently installed.)
Preparing to unpack .../openssl_1.1.1n-0+deb11u4_amd64.deb ...
Unpacking openssl (1.1.1n-0+deb11u4) ...
Selecting previously unselected package ca-certificates.
Preparing to unpack .../ca-certificates_20210119_all.deb ...
Unpacking ca-certificates (20210119) ...
Setting up openssl (1.1.1n-0+deb11u4) ...
Setting up ca-certificates (20210119) ...
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 14m 47s
207 actionable tasks: 142 executed, 53 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/szltlg7ujnelq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
