See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1231/display/redirect?page=changes>
Changes:
[relax] Fix timer consistency in direct runner
[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)
[Jan Lukavský] Change links to Books from Amazon to Publisher
[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)
[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)
------------------------------------------
[...truncated 63.38 KB...]
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0204000432-905fd93d
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0204000432-905fd93d
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1643933067841.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0204000432-905fd93d
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0204000432-905fd93d
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1643933067841.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0204000432-4a7b234
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0204000432-4a7b234
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1643933067889.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0204000432-4a7b234
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0204000432-4a7b234
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1643933067889.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:121
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApi FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
8 tests completed, 3 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords
FAILED
java.lang.RuntimeException at BigQueryNestedRecordsIT.java:114
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GAvro FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryReadEmpty
FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageQueryIT >
testBigQueryStorageQuery1G FAILED
java.lang.RuntimeException at BigQueryIOStorageQueryIT.java:94
org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT > testE2EBigtableRead FAILED
java.lang.RuntimeException at BigtableReadIT.java:58
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageReadIT >
testBigQueryStorageRead1GArrow FAILED
java.lang.RuntimeException at BigQueryIOStorageReadIT.java:102
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1G FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringTableFunction FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:198
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT >
testE2EV1WriteWithLargeEntities FAILED
java.lang.RuntimeException at V1WriteIT.java:190
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1M FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClusteringDynamicDestinations FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:221
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testLegacyQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT >
testDatastoreWriterFnWithDuplicatedEntities FAILED
java.lang.RuntimeException at V1WriteIT.java:137
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOReadIT > testBigQueryRead1T FAILED
java.lang.RuntimeException at BigQueryIOReadIT.java:86
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryTimePartitioning FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:144
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testNewTypesQueryWithoutReshuffle FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write FAILED
java.lang.RuntimeException at V1WriteIT.java:88
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldAddition FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.bigquery.BigQueryTimePartitioningClusteringIT >
testE2EBigQueryClustering FAILED
java.lang.RuntimeException at BigQueryTimePartitioningClusteringIT.java:169
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT >
testStandardQueryWithoutCustom FAILED
java.lang.RuntimeException at BigQueryToTableIT.java:116
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOReadWriteIT > testHL7v2IOE2E FAILED
java.lang.RuntimeException at HL7v2IOReadWriteIT.java:119
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaUpdateOptionsIT >
testAllowFieldRelaxation FAILED
java.lang.RuntimeException at BigQuerySchemaUpdateOptionsIT.java:154
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:85
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED
java.lang.RuntimeException at V1ReadIT.java:92
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:57
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.RuntimeException at SpannerReadIT.java:169
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite
FAILED
java.lang.RuntimeException at BigtableWriteIT.java:129
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.RuntimeException at SpannerReadIT.java:149
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.healthcare.HL7v2IOWriteIT > testHL7v2IOWrite FAILED
java.lang.RuntimeException at HL7v2IOWriteIT.java:92
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT >
testE2EV1ReadWithGQLQueryWithNoLimit FAILED
java.lang.RuntimeException at V1ReadIT.java:135
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
java.lang.RuntimeException at SpannerReadIT.java:201
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:262
39 tests completed, 34 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220204000115
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2443097a3d5abff53448f580a3853adb25aa82d3040185a48be3da006b51c16a
Deleted: sha256:8bd82b100aa60d636cbad3716f186551894930d222b269f952d61672dc62e9d0
Deleted: sha256:bf585ddf5dee15dba90ffea5711eb762b36d6913c5d098c26c6e35fc9896a38d
Deleted: sha256:03018e3638b86d157ea908636dabc68c551c9bf3b706891c56981023ca9745d9
Deleted: sha256:1bad10343c562d7c23df0eeacce24788a9f804c98fd2c5da081cc4cca88388c2
Deleted: sha256:028f6dac7886acfde563480ede35f52d04e695bc3143ce774890f082683cb488
Deleted: sha256:a4c1a0bed98d1b96f4c90bdcfb3c70b6476ced90374cd43a7a2d04e86c958628
Deleted: sha256:d2e1aca93fb908cb4d9478cf9245d15d8f1e29ee77823743f94a3af19f48f6b6
Deleted: sha256:dc51826125c55da7418e2da76eb0f0fea50a54ca0c1a167a5ab98eaa21456b5e
Deleted: sha256:3e812130705ba2facb2a7655cd6265bbcffe6da0b09144ccdb43721f4be90636
Deleted: sha256:d9ba39ba553636a1143548871cc7cde9b31f98b600b3a9d20ff0576826806051
Deleted: sha256:90ad0809b7945347a531f9d06467e7e723d9215f98f096434cd5ebabed559f56
Deleted: sha256:c75b425715b47f5da69bc8ea07b9c5681bd1a3a2da201663809327ff8b19b90d
Deleted: sha256:3befa7d331676494ff81bd6f3cee51605a6f2b4a0a1bf09878fe51bed462d6a0
Deleted: sha256:741042933612e3b65e0a2057cdd956de6cef03f5e1f44b3d15a4faa355fa1806
Deleted: sha256:bdde92afb7cdbb53d9d81549e59f0da43bb6b5059b62b1ffde26520214f0cb21
Deleted: sha256:0fb1fdae87cbdf91d310827acecc56b4237edc3abb1178b4e16d8d6976034f50
Deleted: sha256:154a9bef6bd3f4687e07e8bfbead490151c4885f0f4a96b7dbc5cba99e042c3a
Deleted: sha256:6a88fa9b4bc1bf372647dc85940938395f5e0624ba075e8280a2b69692903b2a
Deleted: sha256:075c7ff5d4fb0edc04e3965e78468124bc9698bda23358ef4def98d0df97de90
Deleted: sha256:d144c984e7f35459ba62da1335317bfcc33283e67d5db69ffd2c623d8d349882
Deleted: sha256:2301ad4db4805fa139305c22071489cb50776bf966156623c57a3efdbc14cebe
Deleted: sha256:3e3e071122c4f97c626f89b81d4b8ac53b3c3186c5ec976076437bc3dac03beb
Deleted: sha256:2ef999a07049af7aa377eeaeb93076d5ab1cf3c65387c3e1c87d39df21678712
Deleted: sha256:bdf50a7575cc373c4d06aa87d8e078044fd6911d01a167f58deb9f7dead74db0
Deleted: sha256:cd1bc183e23a21f3ac1b12cbd618f89922b3535ea650f80a464c527433ae6a42
Deleted: sha256:4ddca5fcb1cd1b2c0fd63c8cda8a19aa27eadb58a2db1cf3213e9d9d1e4f0a07
Deleted: sha256:08ab2a6a40dd1be526023719acb086a75fb50cc5797a5c46ee141d9f32597536
Deleted: sha256:e017dee55bbf3338dcfdc0747d78660aa9e70aac39d1e2dbc13e8bcb4d6e2bbc
Deleted: sha256:786feee0efb917c129308529a27a16249a697acd70355e33a6e44812d9504cee
Deleted: sha256:af5008e5631f209a07bbbf9ac8ad9836adb75c5d4aaf4d5580159f939efffadf
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220204000115]
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 294
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 55m 14s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/3vs6fsw5qehbe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
