See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1592/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
[noreply] Make S3 streaming more efficient (#15931)
------------------------------------------
[...truncated 27.37 KB...]
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for slf4j-simple-1.7.30:
http://www.opensource.org/licenses/mit-license.php. Retrying...
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:container:pullLicenses
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-core-1.41.0:
https://opensource.org/licenses/Apache-2.0. Retrying...
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:arrow:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 57.8419 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
4596a73cf6cd: Preparing
3b417d602a3b: Preparing
6a5ae24416ee: Preparing
8f32084374f2: Preparing
e0ff30b4926c: Preparing
080969ecc93c: Preparing
fed65714761c: Preparing
d926e9c6afd0: Preparing
2ee8b9237224: Preparing
4596a73cf6cd: Waiting
21e3971edc0b: Preparing
5000afc8aae0: Preparing
624ae0cc7a12: Preparing
bff9fe6e429c: Preparing
7c245b2fe4f1: Preparing
6a5ae24416ee: Waiting
f9e18e59a565: Preparing
26a504e63be4: Preparing
8bf42db0de72: Preparing
31892cc314cb: Preparing
11936051f93b: Preparing
8f32084374f2: Waiting
11936051f93b: Waiting
e0ff30b4926c: Waiting
2ee8b9237224: Waiting
080969ecc93c: Waiting
21e3971edc0b: Waiting
fed65714761c: Waiting
d926e9c6afd0: Waiting
5000afc8aae0: Waiting
7c245b2fe4f1: Waiting
f9e18e59a565: Waiting
26a504e63be4: Waiting
8bf42db0de72: Waiting
624ae0cc7a12: Waiting
31892cc314cb: Waiting
bff9fe6e429c: Waiting
3b417d602a3b: Pushed
bff9fe6e429c: Layer already exists
7c245b2fe4f1: Layer already exists
26a504e63be4: Layer already exists
f9e18e59a565: Layer already exists
8bf42db0de72: Layer already exists
31892cc314cb: Layer already exists
11936051f93b: Layer already exists
e0ff30b4926c: Pushed
6a5ae24416ee: Pushed
080969ecc93c: Pushed
4596a73cf6cd: Pushed
8f32084374f2: Pushed
d926e9c6afd0: Pushed
2ee8b9237224: Pushed
fed65714761c: Pushed
5000afc8aae0: Pushed
624ae0cc7a12: Pushed
21e3971edc0b: Pushed
20211222180112: digest:
sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25 size:
4311
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
org.apache.beam.examples.complete.TfIdfIT > initializationError FAILED
java.lang.NoClassDefFoundError at Class.java:-2
Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> initializationError FAILED
java.lang.NoClassDefFoundError at Class.java:-2
Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382
org.apache.beam.examples.cookbook.BigQueryTornadoesIT > initializationError
FAILED
java.lang.NoClassDefFoundError at Class.java:-2
Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382
org.apache.beam.examples.complete.TrafficMaxLaneFlowIT > initializationError
FAILED
java.lang.NoClassDefFoundError at Class.java:-2
Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382
org.apache.beam.examples.complete.TrafficRoutesIT > initializationError FAILED
java.lang.NoClassDefFoundError at Class.java:-2
Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382
5 tests completed, 5 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222180112
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222180112]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222180112]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccb03a8eb96daa27e1922eb83de56912986002fc8985fb58d095c7da04642a25].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
81 actionable tasks: 48 executed, 31 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ljmckecimr7ei
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
