See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/967/display/redirect?page=changes>
Changes:
[kileysok] Increase timeout for Dataflow Streaming VR
[Kyle Weaver] [BEAM-13220] Update release instructions.
[noreply] Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to
[noreply] [BEAM-13284] Respect expiration time for all Redis write methods.
[noreply] [BEAM-12697] Add SBE module and initial classes (#15733)
[noreply] [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit
[Kyle Weaver] [BEAM-13337] Periodically delete stale spanner databases.
[noreply] [BEAM-13115][Playground] Security – Mock Storage (#16047)
[noreply] [BEAM-13335] Use shorter, numerical indices for dataframe reads.
[noreply] Be more conservative about rebatching. (#16058)
[noreply] [BEAM-12587] Allow None in Python's Any logical type. (#16055)
------------------------------------------
[...truncated 53.57 KB...]
> Task :runners:direct-java:compileJava
> Task :sdks:java:io:kafka:compileJava
> Task :sdks:java:io:google-cloud-platform:compileJava
> Task :sdks:java:extensions:ml:compileJava
> Task :sdks:java:extensions:ml:classes
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:kafka:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:kafka:classes
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:container:java8:dockerPrepare
> Task :runners:direct-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:direct-java:classes
> Task :sdks:java:container:java8:docker
---> e7a23a271eea
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
> Task :runners:direct-java:shadowJar
> Task :sdks:java:container:java8:docker
---> dafcef7cfde1
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 3eaf6e4e1e3e
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> cbbc2f8591ca
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> 9aa6a1a3fa13
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> 38386e5c3945
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> b6a41678fa84
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 7674826bc9ef
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 7341f02b29f9
Removing intermediate container 7341f02b29f9
---> d389eb4db71d
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 6ebbbe8e146e
Removing intermediate container 6ebbbe8e146e
---> 70f055792de2
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> de1c2063f75c
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in b6fa2fd9c65f
Removing intermediate container b6fa2fd9c65f
---> 123f9c201f40
Successfully built 123f9c201f40
Successfully tagged apache/beam_java8_sdk:2.36.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
26fb0c0f4d8e: Preparing
2792bb6ed61a: Preparing
975ab1d13eda: Preparing
362b1d43bf9f: Preparing
c283eda9baf1: Preparing
81f3975a6705: Preparing
3d4f1220fc12: Preparing
cba0e20d200b: Preparing
4947612248cf: Preparing
3e51373b8e51: Preparing
32b2a6ff3b31: Preparing
cc1d8c890b0f: Preparing
51244409158f: Preparing
3d4f1220fc12: Waiting
153f9e5be619: Preparing
ab9d251e27cb: Preparing
cba0e20d200b: Waiting
8a5844586fdb: Preparing
a4aba4e59b40: Preparing
5499f2905579: Preparing
4947612248cf: Waiting
3e51373b8e51: Waiting
a36ba9e322f7: Preparing
32b2a6ff3b31: Waiting
153f9e5be619: Waiting
a4aba4e59b40: Waiting
8a5844586fdb: Waiting
ab9d251e27cb: Waiting
a36ba9e322f7: Waiting
5499f2905579: Waiting
51244409158f: Waiting
cc1d8c890b0f: Waiting
2792bb6ed61a: Pushed
c283eda9baf1: Pushed
975ab1d13eda: Pushed
26fb0c0f4d8e: Pushed
362b1d43bf9f: Pushed
81f3975a6705: Pushed
cba0e20d200b: Pushed
4947612248cf: Pushed
51244409158f: Layer already exists
153f9e5be619: Layer already exists
ab9d251e27cb: Layer already exists
3d4f1220fc12: Pushed
8a5844586fdb: Layer already exists
a4aba4e59b40: Layer already exists
5499f2905579: Layer already exists
a36ba9e322f7: Layer already exists
cc1d8c890b0f: Pushed
32b2a6ff3b31: Pushed
3e51373b8e51: Pushed
20211130000029: digest:
sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15 size:
4311
> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :runners:google-cloud-dataflow-java:compileJava
> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:classes
> Task :examples:java:jar
> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1130001358-7ba95018
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1130001358-7ba95018
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1638231232226.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1130001358-7ba95018
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1130001358-7ba95018
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1638231232226.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1130003908-cdfafa76
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1130003908-cdfafa76
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1638232748179.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1130003908-cdfafa76
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1130003908-cdfafa76
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1638232748179.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:261
38 tests completed, 1 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211130000029
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211130000029]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211130000029]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aab703719a8b59c23c6e4367676d3d1000dedfdee020061f72df5fc071bf5e15].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 59m 9s
129 actionable tasks: 115 executed, 12 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nti4rpctwkkpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]