See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/866/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by
[heejong] add test
[heejong] rename variables
[mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on
[mmack] Bump localstack container version for more robust version with respect
[mmack] Bump localstack container version for DynamoDBIOTest to version used in
[mmack] Apply format
[mmack] Apply format
[mmack] Use vendored guava deps
[heejong] rearrange comparison order
[Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation
and
[Robert Bradshaw] Defer filesToStage construction until after full jar
resolution.
[heejong] s/pathes/paths/
[noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0
and
[noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi
------------------------------------------
[...truncated 62.86 KB...]
4801b376d5fa: Waiting
94c94d3b2e6b: Waiting
d8c78014c571: Waiting
36e0782f1159: Waiting
ad31c25c2436: Waiting
ba6e5ff31f23: Waiting
92cf20cc98c7: Waiting
9f9f651e9303: Waiting
62a747bf1719: Waiting
0b3c02b5d746: Waiting
323afe6322de: Pushed
522fbdae3b2a: Pushed
327a41f2c5e8: Pushed
f24c9f666eb0: Pushed
c2bb2ad095e1: Pushed
4801b376d5fa: Pushed
6e5bd8a83b9d: Pushed
23d195f79a1d: Pushed
ebf469e844a6: Layer already exists
94c94d3b2e6b: Layer already exists
36e0782f1159: Layer already exists
ba6e5ff31f23: Layer already exists
9f9f651e9303: Layer already exists
0b3c02b5d746: Layer already exists
62a747bf1719: Layer already exists
92cf20cc98c7: Pushed
ad31c25c2436: Pushed
14f7a6cac52b: Pushed
d8c78014c571: Pushed
20211104180052: digest:
sha256:f27ba0220d46557082cfbe1f33746f2914eac056a076deb5a56a0ab68af79028 size:
4311
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1104180404-a8bb02d9
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104180404-a8bb02d9
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1636049039091.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1104180404-a8bb02d9
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104180404-a8bb02d9
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1636049039091.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1104183249-561d6b8b
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104183249-561d6b8b
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1636050769066.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1104183249-561d6b8b
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104183249-561d6b8b
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1636050769066.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GAvro FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT >
testBigQueryStorageQuery1G FAILED
java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty
FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringTableFunction FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldAddition FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GArrow FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringDynamicDestinations FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED
java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryTimePartitioning FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldRelaxation FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:258
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.util.concurrent.ExecutionException at SpannerReadIT.java:126
Caused by: com.google.cloud.spanner.SpannerException at
SpannerReadIT.java:116
Caused by: io.grpc.StatusRuntimeException at Status.java:535
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.util.concurrent.ExecutionException at SpannerReadIT.java:126
Caused by: com.google.cloud.spanner.SpannerException at
SpannerReadIT.java:116
Caused by: io.grpc.StatusRuntimeException at Status.java:535
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
java.util.concurrent.ExecutionException at SpannerReadIT.java:126
Caused by: com.google.cloud.spanner.SpannerException at
SpannerReadIT.java:116
Caused by: io.grpc.StatusRuntimeException at Status.java:535
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:88
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClustering FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:60
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords
FAILED
java.lang.RuntimeException at BigQueryNestedRecordsIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testLegacyQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite
FAILED
java.lang.RuntimeException at BigtableWriteIT.java:129
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED
java.lang.RuntimeException at HL7v2IOWriteIT.java:92
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT >
testE2EV1WriteWithLargeEntities FAILED
java.lang.RuntimeException at V1WriteIT.java:104
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testStandardQueryWithoutCustom FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED
java.lang.RuntimeException at V1WriteIT.java:69
org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED
java.lang.RuntimeException at BigtableReadIT.java:58
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED
java.lang.RuntimeException at V1ReadIT.java:92
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithNoLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
38 tests completed, 33 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211104180052
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f27ba0220d46557082cfbe1f33746f2914eac056a076deb5a56a0ab68af79028
Deleted: sha256:272dfadd0dafb2d0c18b3cb9950c90e4087bf5e920fc537bc306e4acea9d60a5
Deleted: sha256:5f24dd43f6baaa0764f75980f5bb3830b190600bc2ab2ae983688467b9cedb34
Deleted: sha256:ffb1cb081f11ebb2f02d953510c65e96f713d14eb2c986765abea8fa58311c27
Deleted: sha256:ccb639976fe1bb0c2bde9c4db4f2d848258233ab03bac48c99c172dc7a7f4151
Deleted: sha256:80a4ac9f7c0c512c455e5c9093c6fbf539d213d4a7fbcf4a638a6cb1916fadfa
Deleted: sha256:a3b3101d66ea119d7e2364e646e96197efe75d5e35819855237a904e51c01dc0
Deleted: sha256:8833fbf6f465ef4c7d9fe51770fd51ac0aa312d3b0a565c2b47769cddf5cd740
Deleted: sha256:44fc1f32456e31be6a6963b2dbd0d7433b2d316e48cbced3f2738e533f43b34c
Deleted: sha256:ab8897332ca6e2fe4686182f9f2b4be6b9d324deda47c21313bdf36def0b071e
Deleted: sha256:0a420707f0acd1047cc78ee82417537337e86fab272edf3549651a405b321a43
Deleted: sha256:942b790e23b614771c00ccf4c3395598145aaf243d03a7e84c5f06ded6cc8b10
Deleted: sha256:089b38d6be19c760b878651a25c130cec18a4ed2adac7b98677bd6086425dfaf
Deleted: sha256:86569dc9cb4bd7bb6c571ec628f5c35df9c7ffc54fb3e78b006cb50c7e39faa0
Deleted: sha256:b24ef6d97421fc985e12f8cf0e2aad18c513613c22169238e8b04ef02e7f7e8f
Deleted: sha256:fdadf0596a68aefdf54aecab2b40c1ee1be3d69456c8ac949a25ef2f1f24b6ff
Deleted: sha256:9d6290eb2f5ea62c20143759833212f987f97a3beb7cb423e30d93bd6cd6dfa2
Deleted: sha256:35a69d3c7d9be1a00906a3041edd6bccc6138aa2f43b9cb907cee592406c21f5
Deleted: sha256:affad8e2de139fc0f83762178dababcb8545cf9a1de0d9b0308d620261b12da3
Deleted: sha256:8684aa2cfb9c0e520eaa3ed293bcd99c967cdd1451c7bb51a95f8bbc6e984aea
Deleted: sha256:df401286679d7a5daa6bbfcc6f88387a194a0e726cf31740b22118c6d467979c
Deleted: sha256:77e6b4b09611353cdc473d899a9708c4a8e22bf89931e6ed467db5a6b1e218f9
Deleted: sha256:c61ba6923552f1f939a0f912e963003520e0bdd37f2acc797fc079fcb2527e6e
Deleted: sha256:93911ff02113fb3767174ac293b90606323512dc16594a2dd65a4f5375347dd9
Deleted: sha256:2de56976a6a88eb88b2370e63b4508a69621e4623bedf1863a2fc0c34c9063fc
Deleted: sha256:d11178bbdfb64c97356875f6d61b62f96d9447c76d25e31b04a3cf179068ae1c
Deleted: sha256:b9972bbf7241240061f094c917d00c0b60f9aa57aeb098b4513fcce594620ef9
Deleted: sha256:7e4ea0fd419227f95d374bf4d343b3f0749c55899d14cddd3e94e7435ab2a2c7
Deleted: sha256:e5ca3fe0869fd90ccee9170fb7b243c7d34efde63b0188bec0bb9ac9d651a045
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211104180052]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 41s
129 actionable tasks: 93 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/trprtbs3etfr6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
