See
<https://ci-beam.apache.org/job/beam_PostCommit_Java/7309/display/redirect?page=changes>
Changes:
[yoshiki.obata] [BEAM-9372] remove python version check whether python 3.6
above or not
[shehzaad] [BEAM-10961] enable strict dependency checking for
sdks/java/io/debezium
[shehzaad] [BEAM-10961] Enable strict dependency checking on Google Cloud
Dataflow
[Kenneth Knowles] Include Cron run in postcommit health dashboard
[Robert Bradshaw] [BEAM-11719] Allow encoding protos and dataclasses as
deterministically.
[Robert Bradshaw] Better type inference for GroupBy.
[Robert Bradshaw] Add support for named tuples.
[Robert Bradshaw] Named tuple pickling fix for Python 3.6.
[noreply] [BEAM-11962] Disable failing test (#14202)
[Kenneth Knowles] GroupIntoBatches test uses stateful ParDo
[Kenneth Knowles] Always use portable job submission for Dataflow runner v2
[noreply] [BEAM-11715] [BEAM-11694] Re-enable (conditional) combiner packing.
------------------------------------------
[...truncated 120.04 KB...]
> Task :sdks:java:io:kafka:kafkaVersion241Test
> Task :sdks:java:io:kafka:kafkaVersion251BatchIT
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT
> Task :sdks:java:io:kafka:kafkaVersion251Test
> Task
> :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312001223-d091680c
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312001223-d091680c
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1615507943162.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312001223-d091680c
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312001223-d091680c
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1615507943162.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test
> Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest
> Task :sdks:java:io:hadoop-format:hadoopVersionsTest
> Task :javaHadoopVersionsTest
> Task :sdks:java:extensions:zetasketch:postCommit
> Task
> :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312002432-ccf6285a
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312002432-ccf6285a
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1615508672166.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312002432-ccf6285a
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312002432-ccf6285a
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1615508672166.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT >
testSplitQueryFnWithLargeDataset FAILED
java.lang.AssertionError at SplitQueryFnIT.java:86
45 tests completed, 1 failed, 5 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest
> FAILED
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerKmsIntegrationTest
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
e97f8ffcb395: Preparing
10923f5dfaf8: Preparing
bf06ff7ee689: Preparing
b8d0172b31cf: Preparing
28b120ce0b83: Preparing
16627915e9af: Preparing
53492ab067b5: Preparing
16537b97c472: Preparing
a932335b80a3: Preparing
cd07f4c25169: Preparing
3d9af348bda8: Preparing
9534dfec042a: Preparing
16627915e9af: Waiting
fb0b25718816: Preparing
53492ab067b5: Waiting
e551c18d1724: Preparing
da654bc8bc80: Preparing
4ef81dc52d99: Preparing
909e93c71745: Preparing
7f03bfe4d6dc: Preparing
e551c18d1724: Waiting
16537b97c472: Waiting
da654bc8bc80: Waiting
909e93c71745: Waiting
7f03bfe4d6dc: Waiting
cd07f4c25169: Waiting
9534dfec042a: Waiting
3d9af348bda8: Waiting
fb0b25718816: Waiting
28b120ce0b83: Pushed
10923f5dfaf8: Pushed
b8d0172b31cf: Pushed
e97f8ffcb395: Pushed
bf06ff7ee689: Pushed
16537b97c472: Pushed
53492ab067b5: Pushed
9534dfec042a: Layer already exists
fb0b25718816: Layer already exists
e551c18d1724: Layer already exists
da654bc8bc80: Layer already exists
4ef81dc52d99: Layer already exists
909e93c71745: Layer already exists
7f03bfe4d6dc: Layer already exists
cd07f4c25169: Pushed
3d9af348bda8: Pushed
16627915e9af: Pushed
a932335b80a3: Pushed
20210312000049: digest:
sha256:bcc52114fc3532f3209ef40857513a329f87a6833a08c8745b5d3b9f2f9c4be7 size:
4098
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312014123-e6bde76b
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312014123-e6bde76b
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1615513279350.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312014123-e6bde76b
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312014123-e6bde76b
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1615513279350.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312021008-2da001a5
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312021008-2da001a5
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1615515007539.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0312021008-2da001a5
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0312021008-2da001a5
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1615515007539.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:90
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:62
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT >
testSplitQueryFnWithLargeDataset FAILED
java.lang.AssertionError at SplitQueryFnIT.java:86
36 tests completed, 3 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210312000049
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcc52114fc3532f3209ef40857513a329f87a6833a08c8745b5d3b9f2f9c4be7
Deleted: sha256:9ac89cab40da727ee020b7b26594ab9b041e5c8aa12bcc917040ca1301300b8b
Deleted: sha256:f71f118b3f000444247a5008cf0214ef196e5503fbdee2051d2bf2d9acf96992
Deleted: sha256:e52248a1721e3c28f4a07f4dee000b43885103e18b7c0e1851dd3570be02f541
Deleted: sha256:b90ddcc9c96af4dadc65b0f144262f3b8763855d625b6fadd37d7c0d6bb3cc79
Deleted: sha256:cfdafb657cabfc75333d9617e55e7a78abbb672da2593f547acad8540a2a3d6e
Deleted: sha256:372cd44ea41a4ac78a15849685c683c3ea53e5d441991c58f0763a0a762c3b3c
Deleted: sha256:3082ec5e36e953d64ff51fc845c3706f3c5515b3e1a9c0d1b9295eccab374c51
Deleted: sha256:2729419630281ac2024a4c111320cc459b65c51b650f8378d0c8778fa92bce95
Deleted: sha256:8a725a4e0ec88cc26da8183166bc67618425d354ef68ac736a57452bef9fcd6d
Deleted: sha256:3e210384275eee7e597502e9eee50d8d19bc87a00645c2867fd02fa2bf9a465c
Deleted: sha256:96d78eb818c38547b65fbd6b42d1d34b9acdac9eef0b6a799a06ed93670c477f
Deleted: sha256:1ed4731aa0379bb4fc563dd53d0e55568bae4ea9e2e1a4c19c4fee732bab3d51
Deleted: sha256:087c06dfdc5a020d0c471b478ff3afe18c3d2998c79f135f1e5a92e8384e4884
Deleted: sha256:0682b0e555c84687e294ba2a83fdc0dda9b62df9ba9b6bfe91a7773a02a37aa8
Deleted: sha256:a5b64ed0d95dde3cc9fb92d4d14d4ce43dd7fdae63da265815c93c114603c588
Deleted: sha256:9fa2baeabfdcf0863e4fb47c2dc94e5a5163f80208208edee4ca6885bc1fed52
Deleted: sha256:7ebb7182c50f12c512da5a44656792552efd4773fe4895bffb2e5a8780e07e69
Deleted: sha256:8e686af150c4042ab5e06cd851c91efa14fe26dfb36249e64b6e3be48c6c2302
Deleted: sha256:0a9dd77eb7536cc5b4544c5e99e07c59a20ea2ca00d7ce4009eba8d94ee564ab
Deleted: sha256:c6c307e898a0a27ba388c0d156b0113333d5c7d12ee19babf3f0f9681ab53927
Deleted: sha256:78835593546dda0e019bfd600aef6d3d69a1f96dd50868aead24afd9c6df9c69
Deleted: sha256:08e1f67b2bfcfa1deab4c923b7fd8cccbf847d7010fc2e3ec21af38a9e8cba13
Deleted: sha256:44ce116ff2e9c41ba5c19d23665f311bac0f478e2206621c61e125fe913cbda5
Deleted: sha256:5b19ba241dadd681757e35cfcc1ef51a32e721bae4ce516c8f78281124f93a24
Deleted: sha256:e1189330cd3499734a96ae1f5deba6732961d868aaffc879a242db253a4b6277
Deleted: sha256:95f7a2e5cf83adbe6508be42a64469ef9f0a51e7649c8057dea5d1b1a48f8937
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcc52114fc3532f3209ef40857513a329f87a6833a08c8745b5d3b9f2f9c4be7
Associated tags:
- 20210312000049
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210312000049
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210312000049].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcc52114fc3532f3209ef40857513a329f87a6833a08c8745b5d3b9f2f9c4be7].
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:google-cloud-platform:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/sdks/java/io/google-cloud-platform/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformLegacyWorkerIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 28m 10s
249 actionable tasks: 160 executed, 87 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/vbwbb6if2sim6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]