See
<https://ci-beam.apache.org/job/beam_PostCommit_Java/7313/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Set Dataflow container version correctly in set_version.sh
[Kenneth Knowles] Set Go SDK version in set_version.sh
[Kenneth Knowles] Explain set_version.sh in comments more clearly
[Fokko Driesprong] [BEAM-11926] Improve error when missing Beam schema for
BigqueryIO
[Kenneth Knowles] Add knowledge to `git add` to set_version.sh
[Boyuan Zhang] Add more comments to describe PubSubReadPayload and
PubSubWritePayload.
[noreply] [BEAM-1251] Use Python 3 semantics in Cython-compiled modules.
(#14198)
[noreply] [BEAM-11797] Fixed the flaky test (#14220)
------------------------------------------
[...truncated 112.55 KB...]
---> 05ab4b5534e9
Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> a85a98b9244b
Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 1432f16c38c2
Step 11/17 : COPY target/LICENSE /opt/apache/beam/
---> a2793f1621da
Step 12/17 : COPY target/NOTICE /opt/apache/beam/
---> fa5c82d34d0d
Step 13/17 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> 71a8e5a7b37c
Step 14/17 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
> Task
> :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest
***********************************************************
***********************************************************
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313001216-b5b7b14c
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313001216-b5b7b14c
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:beam_examples.testpipeline_jenkins_0313001216_b5b7b14c
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task :sdks:java:container:java8:docker
---> 3b47b7f55140
Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 4bfbe9902cb6
Removing intermediate container 4bfbe9902cb6
---> 8c951dd11997
Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in a29f65c99a5c
Removing intermediate container a29f65c99a5c
---> 2def1cde6d04
Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in f8fb6034b32c
Removing intermediate container f8fb6034b32c
---> 53ac3d77df61
Successfully built 53ac3d77df61
Successfully tagged apache/beam_java8_sdk:2.30.0.dev
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO292IT
> Task :runners:spark:hadoopVersion292Test
> Task :sdks:java:io:kafka:kafkaVersion201Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO292Test
> Task :sdks:java:io:kafka:kafkaVersion211BatchIT
> Task :sdks:java:io:kafka:kafkaVersion211Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321ElasticIT
> Task :runners:spark:hadoopVersion321Test
> Task :sdks:java:io:kafka:kafkaVersion222BatchIT
> Task :sdks:java:io:kafka:kafkaVersion222Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT
> Task
> :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313001710-eabd61f3
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313001710-eabd61f3
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1615594629163.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313001710-eabd61f3
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313001710-eabd61f3
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1615594629163.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task :sdks:java:io:kafka:kafkaVersion231BatchIT
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test
> Task :sdks:java:io:kafka:kafkaVersion231Test
> Task :runners:spark:hadoopVersionsTest
> Task :sdks:java:io:hadoop-format:hadoopVersionsTest
> Task :javaHadoopVersionsTest
> Task :sdks:java:io:kafka:kafkaVersion241BatchIT
> Task :sdks:java:io:kafka:kafkaVersion241Test
> Task :sdks:java:io:kafka:kafkaVersion251BatchIT
> Task :sdks:java:io:kafka:kafkaVersion251Test
> Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest
> Task :sdks:java:extensions:zetasketch:postCommit
> Task
> :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313002847-560f7d79
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313002847-560f7d79
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1615595326663.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313002847-560f7d79
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313002847-560f7d79
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1615595326663.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerKmsIntegrationTest
> Task :runners:google-cloud-dataflow-java:postCommit
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
9fb318991dbc: Preparing
0966a6004add: Preparing
41af7829c016: Preparing
a1b29ae1e0f1: Preparing
9c60d7216766: Preparing
b98b103c7f42: Preparing
a099c867a029: Preparing
7331174288e1: Preparing
4c5e3033bef1: Preparing
2d8c5ca5c73a: Preparing
8663108c4e85: Preparing
8a970d4156d3: Preparing
09ac04d65797: Preparing
59f1e8e1ce66: Preparing
bde301416dd2: Preparing
a099c867a029: Waiting
b98b103c7f42: Waiting
81496d8c72c2: Preparing
644448d6e877: Preparing
0e41e5bdb921: Preparing
7331174288e1: Waiting
4c5e3033bef1: Waiting
2d8c5ca5c73a: Waiting
8663108c4e85: Waiting
09ac04d65797: Waiting
59f1e8e1ce66: Waiting
644448d6e877: Waiting
0e41e5bdb921: Waiting
8a970d4156d3: Waiting
81496d8c72c2: Waiting
bde301416dd2: Waiting
9fb318991dbc: Pushed
0966a6004add: Pushed
a1b29ae1e0f1: Pushed
9c60d7216766: Pushed
7331174288e1: Pushed
a099c867a029: Pushed
41af7829c016: Pushed
8a970d4156d3: Layer already exists
09ac04d65797: Layer already exists
59f1e8e1ce66: Layer already exists
bde301416dd2: Layer already exists
81496d8c72c2: Layer already exists
644448d6e877: Layer already exists
2d8c5ca5c73a: Pushed
0e41e5bdb921: Layer already exists
8663108c4e85: Pushed
b98b103c7f42: Pushed
4c5e3033bef1: Pushed
20210313000109: digest:
sha256:fd6a9564ffcfd681dcdad18f4270d1c9c67c8f8b96d58fb5096263602a5e8317 size:
4098
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313014304-8399f867
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313014304-8399f867
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1615599779809.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313014304-8399f867
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313014304-8399f867
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1615599779809.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313021019-e7bfc45
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313021019-e7bfc45
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1615601419072.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0313021019-e7bfc45
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0313021019-e7bfc45
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1615601419072.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:90
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:62
36 tests completed, 2 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210313000109
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6a9564ffcfd681dcdad18f4270d1c9c67c8f8b96d58fb5096263602a5e8317
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6a9564ffcfd681dcdad18f4270d1c9c67c8f8b96d58fb5096263602a5e8317
Associated tags:
- 20210313000109
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210313000109
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210313000109].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6a9564ffcfd681dcdad18f4270d1c9c67c8f8b96d58fb5096263602a5e8317].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 27m 15s
249 actionable tasks: 179 executed, 68 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/v2z3hhnmqpb7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
