See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/727/display/redirect?page=changes>
Changes: [dpcollins] [BEAM-12908] Change to use PubsubSignal for information propagation so [Robert Bradshaw] Preserve more types in transform replacement. [Robert Bradshaw] Update test to reflect preserved type hint. [noreply] [BEAM-11985] Python Bigtable - Implement IO Request Count metrics ------------------------------------------ [...truncated 57.59 KB...] > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 6eef30e1b248: Preparing e0d3c0ab729a: Preparing 7b0f0eeeab56: Preparing 481fc3c01cd1: Preparing 7085102c7d28: Preparing 28c7e8b0af09: Preparing 75215df4d8a6: Preparing 84de209ceceb: Preparing 398661fab6d6: Preparing 475008c06d20: Preparing 9dcbfa137007: Preparing bea07a4f3795: Preparing ab19b46e9384: Preparing 84de209ceceb: Waiting 28c7e8b0af09: Waiting 475008c06d20: Waiting 9dcbfa137007: Waiting 398661fab6d6: Waiting 080ef0ba5cc0: Preparing bea07a4f3795: Waiting d08e6b97bf21: Preparing 75215df4d8a6: Waiting ab19b46e9384: Waiting 3054497613e6: Preparing d35dc7f4c79e: Preparing 080ef0ba5cc0: Waiting dabfe5b2ea81: Preparing d08e6b97bf21: Waiting 5e6a409f30b6: Preparing 3054497613e6: Waiting 5e6a409f30b6: Waiting d35dc7f4c79e: Waiting dabfe5b2ea81: Waiting e0d3c0ab729a: Pushed 7085102c7d28: Pushed 7b0f0eeeab56: Pushed 28c7e8b0af09: Pushed 6eef30e1b248: Pushed 481fc3c01cd1: Pushed 84de209ceceb: Pushed 398661fab6d6: Pushed ab19b46e9384: Layer already exists 080ef0ba5cc0: Layer already exists d08e6b97bf21: Layer already exists 3054497613e6: Layer already exists d35dc7f4c79e: Layer already exists dabfe5b2ea81: Layer already exists 9dcbfa137007: Pushed 5e6a409f30b6: Layer already exists 75215df4d8a6: Pushed bea07a4f3795: Pushed 475008c06d20: Pushed 20211001000050: digest: sha256:1626082c09f537ab08f051c068c6e85247eba5fa09512bd8e79ead3dd73c789e size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1001000349-b3839d4b The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1001000349-b3839d4b ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1633046625328.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1001000349-b3839d4b The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1001000349-b3839d4b The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1633046625328.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1001003115-10990511 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1001003115-10990511 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1633048274932.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1001003115-10990511 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1001003115-10990511 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1633048274932.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT > testBigQueryStorageQuery1G FAILED java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT > testBigQueryStorageRead1GAvro FAILED java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClusteringTableFunction FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT > testAllowFieldAddition FAILED java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT > testBigQueryStorageRead1GArrow FAILED java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClusteringDynamicDestinations FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119 org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT > testAllowFieldRelaxation FAILED java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryTimePartitioning FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:88 org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:258 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED java.lang.AssertionError at PubsubReadIT.java:60 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClustering FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169 org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords FAILED java.lang.RuntimeException at BigQueryNestedRecordsIT.java:116 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testNewTypesQueryWithReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite FAILED java.lang.RuntimeException at BigtableWriteIT.java:130 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED java.lang.RuntimeException at SpannerReadIT.java:169 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testLegacyQueryWithoutReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED java.lang.RuntimeException at HL7v2IOWriteIT.java:92 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testNewTypesQueryWithoutReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1WriteWithLargeEntities FAILED java.lang.RuntimeException at V1WriteIT.java:104 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED java.lang.RuntimeException at SpannerReadIT.java:149 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testStandardQueryWithoutCustom FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED java.lang.RuntimeException at V1WriteIT.java:69 org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED java.lang.RuntimeException at BigtableReadIT.java:58 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED java.lang.RuntimeException at SpannerReadIT.java:201 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED java.lang.RuntimeException at V1ReadIT.java:92 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithLimit FAILED java.lang.RuntimeException at V1ReadIT.java:135 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithNoLimit FAILED java.lang.RuntimeException at V1ReadIT.java:135 38 tests completed, 33 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211001000050 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211001000050] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 17m 24s 129 actionable tasks: 88 executed, 39 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/4csxmn7rx6x5a Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
