See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1139/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13602] Prevented metrics gathering from failing bigtable io
[ningkang0957] make the code more pythonic
[Robert Bradshaw] Optional args and kwargs for named external transforms.
[noreply] [BEAM-13432] Skip ExpansionService creation in Job Server (#16222)
------------------------------------------
[...truncated 61.95 KB...]
f9e18e59a565: Waiting
31892cc314cb: Preparing
11936051f93b: Preparing
8bf42db0de72: Waiting
26a504e63be4: Waiting
bff9fe6e429c: Waiting
737ae540f5b7: Pushed
b16cb8ea23d4: Pushed
8752c24c1182: Pushed
c3aafd47f12b: Pushed
89cbab2c42b3: Pushed
f66fb391c97d: Pushed
0492cf8c5d11: Pushed
d8d9e68187d8: Pushed
44a6cc9c29dc: Pushed
eaea80b07a03: Pushed
7d91df2667e4: Pushed
bff9fe6e429c: Layer already exists
7c245b2fe4f1: Layer already exists
f9e18e59a565: Layer already exists
26a504e63be4: Layer already exists
8bf42db0de72: Layer already exists
31892cc314cb: Layer already exists
11936051f93b: Layer already exists
2ab9ec3a656e: Pushed
f29c82051df8: Pushed
20220112000057: digest:
sha256:a6ef21063d55fa936c1c8bf419408fddca280c7bb8d3c6e8b766aff5e7cd9b2b size:
4520
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0112000438-1d1afd70
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0112000438-1d1afd70
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1641945871173.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0112000438-1d1afd70
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0112000438-1d1afd70
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1641945871173.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0112000437-3cd0284f
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0112000437-3cd0284f
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1641945871134.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0112000437-3cd0284f
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0112000437-3cd0284f
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1641945871134.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT >
testBigQueryStorageQuery1G FAILED
java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty
FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords
FAILED
java.lang.RuntimeException at BigQueryNestedRecordsIT.java:114
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringTableFunction FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198
org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED
java.lang.RuntimeException at BigtableReadIT.java:58
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringDynamicDestinations FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT >
testE2EV1WriteWithLargeEntities FAILED
java.lang.RuntimeException at V1WriteIT.java:104
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED
java.lang.RuntimeException at V1WriteIT.java:69
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryTimePartitioning FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED
java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClustering FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldAddition FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:85
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.RuntimeException at SpannerReadIT.java:169
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldRelaxation FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:57
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite
FAILED
java.lang.RuntimeException at BigtableWriteIT.java:129
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GAvro FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.RuntimeException at SpannerReadIT.java:149
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED
java.lang.RuntimeException at HL7v2IOWriteIT.java:92
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GArrow FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
java.lang.RuntimeException at SpannerReadIT.java:201
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testLegacyQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testStandardQueryWithoutCustom FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED
java.lang.RuntimeException at V1ReadIT.java:92
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithNoLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:262
38 tests completed, 33 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220112000057
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ef21063d55fa936c1c8bf419408fddca280c7bb8d3c6e8b766aff5e7cd9b2b
Deleted: sha256:c090426412e2209a591240547ef4affe1088651ad44d596db3f7e18eda2054a4
Deleted: sha256:6b17cf52f1975b16e1044648115b6605f8b0d2a0f28614235f875c9f8733e1c3
Deleted: sha256:6a4a8f6c166f6041ddead6fc13515d0fb31f7499a042e5494a55aa8cfd71e591
Deleted: sha256:c7d64fbd9e79b927461a2e6aa2f5df2110576185651ec021ffced73fa3dc2646
Deleted: sha256:dbe14096c222ac696ae4a0a746220b9ba41f2fbc62e953d2ff9d4178483fa885
Deleted: sha256:91c152169b272020accf6ca47984676a81ecaca1b0e156c5b6bb6eaf3aaf4296
Deleted: sha256:8ab2cfa566081e2f64b4e32449c4dd1e97843823fc1c1d73dab3d0efe373b572
Deleted: sha256:ae1901051baf13c9616d3550884a5ae0ea0abb597613b1b3481ef4d38af6006d
Deleted: sha256:294e7a0011cd43a16c40937ddb8d583bdab65bb924aa587c5808c2ac71be2ce4
Deleted: sha256:167eedd195d8b3bba9191d17a3ade511e59f8ee3a9e06cff589b7c8a29057397
Deleted: sha256:470c269d0528f5a76bd7fa965466f5d673ba68926c5fd01dbb1ea5e3c8c1996b
Deleted: sha256:cfb9c44041d4fb11eb5d06c1136f2f62054813d80338e75ea3430bd197697253
Deleted: sha256:00e008e3d33632738b817be99b111177488276490a28e252ab5f927f727a4c6f
Deleted: sha256:eec87e6fb84528ebe32a5f968c5562cadd1e06b688dda0e102fa185b89175121
Deleted: sha256:a4f2b0d82db5e02fef0dcd9e4ba3573738d177528a000e04550b790cf3cc67b7
Deleted: sha256:c5dfb918fd79055f537c4d932f2f19128b74fac1061445839f3713421d3f1562
Deleted: sha256:a503bc4ce57f346ed8cf974aaec4215d60b13a9cee1ab971c06d7efe0e64c4bf
Deleted: sha256:9e646c5038bcae2ecc0c71f1e68771f46917253b1a36271652ce208ce93a32fa
Deleted: sha256:357a215cbcdc1c592d0b7058805e594bcc1955caeb4211606270f93d23a94b8f
Deleted: sha256:f478521735ac59954687ba57dd5affa9655e51deb4e7ae7240b71fe0a7f5d1ab
Deleted: sha256:9db7499d99e1d63e0f6f5c627c9f88fe208b6855f79532df6fa37ad4a173a87d
Deleted: sha256:34506e59fc56909e621b44f050cbab32e295940968fd1cc266e2cbdc9d12a2c6
Deleted: sha256:270beeffe9935d88d294b4e371cc0da503cb57fc4e17cd5c8e2b7366db54fed7
Deleted: sha256:ba449d54c948b3195fc372f548aec26376692d0155f1f37eb1a4c952f9e1bee3
Deleted: sha256:1fc6eb98df4b804b3632590c498039ad3c3129d898cdf072e20411596f047a58
Deleted: sha256:26b71dada2192f31d6b6e8d471d8d8534dbf2bc3caa187d1b05255daa1608c05
Deleted: sha256:1def42cbbcbaa698334416c1d8c0a68284b2718b34d999ddd846d4d28b167639
Deleted: sha256:6c89a82aca1670f4bc90aae7adad9755cf09ae80d0a58b1f5a4e4fc35e1b4261
Deleted: sha256:f46dd81595c25cec705364112179d44817bf738121fad596726472212b0768cf
Deleted: sha256:4565a12637c325ee30743d354f6aa26c46c03a9fc541c67845a2c3f0da2c8ece
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220112000057]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 287
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 51m 42s
141 actionable tasks: 93 executed, 44 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/b4xm4yjtnthi4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
