See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/899/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[aydar.zaynutdinov] [BEAM-13224][Playground]
[noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu…
[noreply] [BEAM-3304] Refactor trigger API (#15952)
[noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter
interface
------------------------------------------
[...truncated 54.92 KB...]
9f9f651e9303: Waiting
ffa454d59489: Waiting
0b3c02b5d746: Waiting
62a747bf1719: Waiting
94c94d3b2e6b: Waiting
58b4ce8645bc: Pushed
d68e1cf2ad05: Pushed
0d889f2909c4: Pushed
f1c23c962b73: Pushed
6168974f44f6: Pushed
24df777a5c44: Pushed
5fbdb80a091c: Pushed
ffa454d59489: Pushed
ebf469e844a6: Layer already exists
9ff12bb10c46: Pushed
94c94d3b2e6b: Layer already exists
36e0782f1159: Layer already exists
ba6e5ff31f23: Layer already exists
9f9f651e9303: Layer already exists
62a747bf1719: Layer already exists
0b3c02b5d746: Layer already exists
a3a7b3f675d7: Pushed
2c1ea7aae0f8: Pushed
c930a508f0a3: Pushed
20211113000059: digest:
sha256:d379c20c18f266961848bde3d332124635124ed7459acf9b2cdfa6e151045b57 size:
4311
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1113000447-f953f474
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1113000447-f953f474
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1636761882208.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1113000447-f953f474
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1113000447-f953f474
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1636761882208.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:121
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2EBigQueryTornadoesWithExport FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApi FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.complete.TrafficMaxLaneFlowIT >
testE2ETrafficMaxLaneFlow FAILED
java.lang.RuntimeException at TrafficMaxLaneFlowIT.java:74
8 tests completed, 5 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GAvro FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT >
testBigQueryStorageQuery1G FAILED
java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringTableFunction FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty
FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GArrow FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringDynamicDestinations FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldAddition FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryTimePartitioning FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldRelaxation FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED
java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:88
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:261
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClustering FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:60
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.RuntimeException at SpannerReadIT.java:169
org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords
FAILED
java.lang.RuntimeException at BigQueryNestedRecordsIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.RuntimeException at SpannerReadIT.java:149
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite
FAILED
java.lang.RuntimeException at BigtableWriteIT.java:129
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testLegacyQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
java.lang.RuntimeException at SpannerReadIT.java:201
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED
java.lang.RuntimeException at HL7v2IOWriteIT.java:92
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT >
testE2EV1WriteWithLargeEntities FAILED
java.lang.RuntimeException at V1WriteIT.java:104
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testStandardQueryWithoutCustom FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED
java.lang.RuntimeException at V1WriteIT.java:69
org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED
java.lang.RuntimeException at BigtableReadIT.java:58
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED
java.lang.RuntimeException at V1ReadIT.java:92
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithNoLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
38 tests completed, 33 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211113000059
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d379c20c18f266961848bde3d332124635124ed7459acf9b2cdfa6e151045b57
Deleted: sha256:a9f893528b33c8fb2b6e54995ec19a14b8a134e1dabb693d352ca44c05bd43d6
Deleted: sha256:02440c81fddb4a344889423bdd727b93281286338d31daee7a935525a6759bb2
Deleted: sha256:0d3c3c06ae5605b134d0f1afb4efbb223637dab13b17e4ddcdd9cb497e84a3f8
Deleted: sha256:95b75cc569e995aee8964bd843581ec081041e836bffe97ae1116e71224933c3
Deleted: sha256:6e3837d333fd9560942eee41edba17d9dc856a0df64550bb7ac340f7843d0737
Deleted: sha256:b6fd848ff80afe79f3f4c0eb3e462ee0cb01018fe853d17a6a52e8e7e3b4e3dd
Deleted: sha256:2c49951feafc7f6f33165dd174f839de923c276fb1a1c757a61dcbc42608b85a
Deleted: sha256:dc65d7d78f71a537081ff1f62a412bffc2f79b7d1ad50a2d9ff23eb56946a3a1
Deleted: sha256:2d4a956a9b72b3d8dc4be06f51e5f42f980fb9fbdaa327b85303930cefa57e06
Deleted: sha256:ca8d884f705e3dac6d3ded124435a8e9cf650f7088128d8dca6ec8790c3e1c5e
Deleted: sha256:d4fbc2563cc30f51d74e8cddaa0ebf5672452369c47c81939b55a3a110513748
Deleted: sha256:248fbcf4e1eabef3308a8bc3cf484837108b62766a3bff01d90e8cc6ea806f23
Deleted: sha256:083e19d10705d3ca74c3f37ae80289fbc6235bd7193866ff65258e7964b89d9f
Deleted: sha256:758f47b188e933b315d134b480e1b8b99b43a39872cfed7eaeea899a3d332d09
Deleted: sha256:abc1fc03f40241ef7aedae0745acd4033e8e55d6064df8a42a8b5ef3f21be3c5
Deleted: sha256:263e6f3273d961b551564c1bdd6da339e1829d48e3215bd20d438ca509fc83ba
Deleted: sha256:90861480d529fe9e771f63d6bb9d7418903d496def49a004b4589d690b68f79b
Deleted: sha256:3576dbfaee2c5f1edf272b80bf4723692d581f0bc2ac84f7eac96c1ce9810637
Deleted: sha256:1f3453861a677c458564edfbde491c07c7cdbd393ccfa23bb063d485dee82117
Deleted: sha256:1a6f4028f6f78fa848c254375ec8e61fdda7e48a0e54d2bcfbd46e5566d00889
Deleted: sha256:a4ce6b4ed6cbc6769f27c8b5a9f5178f3495c2fc71b58f0f174757dd2b5eceec
Deleted: sha256:2d9ef62fe2229c7da51f3b0a62972ee612bce35f618eb4d409aebecd2e9b4ed7
Deleted: sha256:fc60069bc94fe32f7d0a059b51bf25de0db61a5ea3c53961b0e5fb48c17abc44
Deleted: sha256:96cc67f00506084e5417e9d716ea2b4bff1b50c29b2d8b9c96311b16a5b2db0e
Deleted: sha256:7530c9d131ddee35ce74cc7ef340df29f127ca3afef9640f3d8cc75fe2f0fc18
Deleted: sha256:528a60f0d69ea51ed73e5444ff2c46962826213b5d0e973f4c0ce020dcfc191d
Deleted: sha256:96d87d6f6533ede4467803dd88750e433ca3acf845aea65599c58d9ac8d6e776
Deleted: sha256:34da3d1e2c9d9ad04aa66a2cec76e3069a1b05d89ae0b16ab72db9d4f0a88577
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211113000059]
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 35m 54s
129 actionable tasks: 87 executed, 40 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fg262l3mqazfw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]