See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1378/display/redirect?page=changes>
Changes:
[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored
java
[dhuntsperger] adding a list of example pipelines
[dhuntsperger] removing unnecessary `ls` command from maven project generation
[dhuntsperger] fixing filename formatting in response to feedback
[dhuntsperger] adding extra step emphasizing runner setupt
[dhuntsperger] reorganized instructions to emphasize setup steps for runners
[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support
[noreply] Adding pydoc for StateHandler (#17091)
[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)
------------------------------------------
[...truncated 64.62 KB...]
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for slf4j-jdk14-1.7.30:
http://www.opensource.org/licenses/mit-license.php. Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-protobuf-lite-1.44.0:
https://opensource.org/licenses/Apache-2.0. Retrying...
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-protobuf-lite-1.44.0:
https://opensource.org/licenses/Apache-2.0. Retrying...
INFO:root:pull_licenses_java.py succeed. It took 62.431547 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
03775a3f51d4: Preparing
c75e6d626076: Preparing
2619637919c0: Preparing
d26b03981f83: Preparing
61bcd913ad11: Preparing
9b796bd5437b: Preparing
6576e51d9a9a: Preparing
4b28a841d3ee: Preparing
191932c64e28: Preparing
961e60e6a7c3: Preparing
4eaeac2db65f: Preparing
b0344d2a3ab2: Preparing
b51bc6222e56: Preparing
9d8709c53aef: Preparing
8e05d451d71e: Preparing
d1609e012401: Preparing
e3f84a8cee1f: Preparing
b0344d2a3ab2: Waiting
48144a6f44ae: Preparing
26d5108b2cba: Preparing
89fda00479fc: Preparing
8e05d451d71e: Waiting
48144a6f44ae: Waiting
d1609e012401: Waiting
26d5108b2cba: Waiting
b51bc6222e56: Waiting
e3f84a8cee1f: Waiting
961e60e6a7c3: Waiting
9b796bd5437b: Waiting
6576e51d9a9a: Waiting
9d8709c53aef: Waiting
4b28a841d3ee: Waiting
c75e6d626076: Pushed
61bcd913ad11: Pushed
2619637919c0: Pushed
03775a3f51d4: Pushed
9b796bd5437b: Pushed
d26b03981f83: Pushed
4b28a841d3ee: Pushed
961e60e6a7c3: Pushed
191932c64e28: Pushed
9d8709c53aef: Layer already exists
8e05d451d71e: Layer already exists
d1609e012401: Layer already exists
b0344d2a3ab2: Pushed
e3f84a8cee1f: Layer already exists
48144a6f44ae: Layer already exists
26d5108b2cba: Layer already exists
89fda00479fc: Layer already exists
b51bc6222e56: Pushed
6576e51d9a9a: Pushed
4eaeac2db65f: Pushed
20220316000107: digest:
sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b size:
4520
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0316000430-d1eb9d24
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316000430-d1eb9d24
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0316000430-d1eb9d24
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316000430-d1eb9d24
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0316000430-85d8d997
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316000430-85d8d997
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0316000430-85d8d997
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316000430-85d8d997
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
44 tests completed, 1 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316000107
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b
Deleted: sha256:79f52a2beaca6fd90f19b0ce85e62c23cb1a63504f47aeaf222e81b6326094a6
Deleted: sha256:431c0e5e15f691e8fc1bf3b76a9e3f9f2d88230a9afada369a0fe095fba43493
Deleted: sha256:9b834693bade04edafc4777e81b9c66600dc5d24630fe5078f98d162f2c23309
Deleted: sha256:22102f76affa2b1cac8f24cf3d9002956bc6ac739e2e27a7e5412305aa54d78b
Deleted: sha256:7bc68a0543578948effc598331896fa22aeaca4944d2e3a0876db326fcbc4098
Deleted: sha256:ffe439972f0983319b128a5b99925d81c7fc634e725ffa25a6dd6c827f42f13a
Deleted: sha256:f88b156c22ee2d4ddc321570624a9678382b2dc7878a17fba0951c0e2a54e9e2
Deleted: sha256:093b434cd7c1d78d4543e76ac09137e9cf161614c553c2da32b0009e57d7b0a9
Deleted: sha256:ca7f63235ff5552c485da03022af698669f1460a9ef3bbc56a51d9f987084138
Deleted: sha256:ede402384b19d389c2426ad1de661910c6deb01a16ce5275b5d490ce1d9f5b99
Deleted: sha256:ff7456e56133d7b420c2d8cc63ff20aa069278753594d219e8ce2720be306d28
Deleted: sha256:4cfe23836891c5ce3c226eee811a4091156230ae6cca7413759c23a813c1c146
Deleted: sha256:beeab637bc1b8a0746c2716b09181d4d9f5f07b73da4ed57dbdda52eee6556e9
Deleted: sha256:5490ca8e3a2cf70d287f7a809eee054b23bed0eb184c4825d0b212b4a719620c
Deleted: sha256:3cb6944899a22061c8148270d19669be20e9e9dbd5919d61acdbea680c5bb966
Deleted: sha256:f0f3979286c6f4bf9dc095305fc490d2bd11b5408536bd0bda8b80ee06278a80
Deleted: sha256:91ce808fdd20e5451efa1b20fc6c808914ac7329d0393cbe844b539a1ec72134
Deleted: sha256:52eccbe2a0ba843fd00270f784e2d4b83d7815ea68b609fd2b313b199aa267d3
Deleted: sha256:c4ff6124dcdcf0ed03d89733cf472eaade196237a8b4cc609af2b1be15ac387a
Deleted: sha256:032a926f1f3c656b65841dbfcaa2dd2acae7f1a8d29cf3d282d09b88c590f861
Deleted: sha256:fa88fff4471722db30b0d0d9584ef2bafacd51600f93822688de857b21f88178
Deleted: sha256:ff75c689323887d89025cdf9c454a2038e39a073e21c2fcfe8e42c8b20a5e0d2
Deleted: sha256:880205b1d1f0971fb78e179c9d9b2d42d5304511421c68d4702e6ca8cbc1930b
Deleted: sha256:a14e2acb9f0b9e931f2bd29070f3f3259a16500c0bf5f11f03db225d874a7773
Deleted: sha256:52614f856fa0f17be87f21eba3240d423cb00031d0c5d5e9edb7d97e1bcb7f2b
Deleted: sha256:8adc555b7377654a9ae1df16bd70f998fe143a8693b8d599c3274fd03c6809b4
Deleted: sha256:c6c03b4b8d7a8ba686c02ef9bffdbfceecc18c88ae0ce362d392117a204db31f
Deleted: sha256:d68303f67e62815ea165497660f615649d08a9eb1226f60a77834353b6e8224c
Deleted: sha256:3ee9e957ccbf528971a01785ac3988d282405fe48dfe1f26299de957e069c9d8
Deleted: sha256:21b2c4578cf39b96e9285a83e739085b364a970fa66f0ea2c8589c2a71d2ea91
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316000107]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316000107]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cbfaa536b810e0e2460b85f22daf5507d6534b1bf7c67b9bf532edd13bb6d3b].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 57m 22s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/wywkbkrheeh24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
