See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/870/display/redirect?page=changes>
Changes: [noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899) [noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773) [noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910) ------------------------------------------ [...truncated 57.86 KB...] As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] efda4f15b3b0: Preparing 073c778f0ed6: Preparing f5b6481c1a31: Preparing 8272ae2df16b: Preparing 12d313a83ed7: Preparing 86af80c1ba4c: Preparing 03c99ea6457d: Preparing b05c476bb686: Preparing 72651ab0f3b9: Preparing 694eb641cccf: Preparing fd17519976ce: Preparing d5de1bd1875f: Preparing ebf469e844a6: Preparing 94c94d3b2e6b: Preparing 03c99ea6457d: Waiting 36e0782f1159: Preparing b05c476bb686: Waiting ba6e5ff31f23: Preparing 9f9f651e9303: Preparing fd17519976ce: Waiting 0b3c02b5d746: Preparing 694eb641cccf: Waiting d5de1bd1875f: Waiting ebf469e844a6: Waiting 94c94d3b2e6b: Waiting 36e0782f1159: Waiting ba6e5ff31f23: Waiting 0b3c02b5d746: Waiting 62a747bf1719: Preparing 62a747bf1719: Waiting f5b6481c1a31: Pushed 073c778f0ed6: Pushed 12d313a83ed7: Pushed efda4f15b3b0: Pushed 8272ae2df16b: Pushed 86af80c1ba4c: Pushed b05c476bb686: Pushed 72651ab0f3b9: Pushed ebf469e844a6: Layer already exists 94c94d3b2e6b: Layer already exists 36e0782f1159: Layer already exists ba6e5ff31f23: Layer already exists 9f9f651e9303: Layer already exists 0b3c02b5d746: Layer already exists 62a747bf1719: Layer already exists 03c99ea6457d: Pushed fd17519976ce: Pushed d5de1bd1875f: Pushed 694eb641cccf: Pushed 20211105180046: digest: sha256:cfacdba133eb29a0b61356d51b05e9332049a58bf0194941c880b01dd0d5eb63 size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1105180337-696123aa The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1105180337-696123aa ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1636135410988.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1105180337-696123aa The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1105180337-696123aa The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1636135410988.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1105182735-2d996774 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1105182735-2d996774 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1636136855311.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1105182735-2d996774 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1105182735-2d996774 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1636136855311.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT > testBigQueryStorageQuery1G FAILED java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClusteringTableFunction FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT > testBigQueryStorageRead1GAvro FAILED java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102 org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT > testAllowFieldAddition FAILED java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClusteringDynamicDestinations FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT > testBigQueryStorageRead1GArrow FAILED java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102 org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT > testAllowFieldRelaxation FAILED java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryTimePartitioning FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:88 org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT > testE2EBigQueryClustering FAILED java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169 org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:258 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED java.lang.RuntimeException at BigQueryIOReadIT.java:86 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED java.lang.AssertionError at PubsubReadIT.java:60 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testNewTypesQueryWithReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords FAILED java.lang.RuntimeException at BigQueryNestedRecordsIT.java:116 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testLegacyQueryWithoutReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite FAILED java.lang.RuntimeException at BigtableWriteIT.java:129 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testNewTypesQueryWithoutReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED java.lang.RuntimeException at HL7v2IOWriteIT.java:92 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testStandardQueryWithoutCustom FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1WriteWithLargeEntities FAILED java.lang.RuntimeException at V1WriteIT.java:104 org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED java.lang.RuntimeException at BigtableReadIT.java:58 org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED java.lang.RuntimeException at V1WriteIT.java:69 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED java.lang.RuntimeException at V1ReadIT.java:92 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithLimit FAILED java.lang.RuntimeException at V1ReadIT.java:135 org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithNoLimit FAILED java.lang.RuntimeException at V1ReadIT.java:135 38 tests completed, 33 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211105180046 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfacdba133eb29a0b61356d51b05e9332049a58bf0194941c880b01dd0d5eb63 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211105180046] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 278 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 8m 37s 129 actionable tasks: 87 executed, 40 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/trvuic4mqapre Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
