See
<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/5336/display/redirect?page=changes>
Changes:
[relax] update GCP cloud libraries BOM to 26.5.0
------------------------------------------
[...truncated 361.50 KB...]
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Jan 27, 2023 2:20:11 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 492 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Jan 27, 2023 2:20:11 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.46.0-SNAPSHOT-wq0zWvhONI8axxgtDkOzsTBUT57aW5LBBFFf8RIaXA8.jar
Jan 27, 2023 2:20:11 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test3070809160719512107.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-DpJ1JKyGf4zguXbto_L1t1hAGSGpqEPTjuTQifRPWDc.jar
Jan 27, 2023 2:20:11 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test1938163482401929788.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-9b3BDkplVUc4sfNrhtubOIbTqtw0jHzSPD-M_PFAe7A.jar
Jan 27, 2023 2:20:11 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/main6919167759939321737.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/main-xnh5W06an02q9e_y59BsLGicV981EX5ATXBLff3U3ZM.jar
Jan 27, 2023 2:20:11 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test2358443233040846555.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-SFdPPOqKXNPy-nnNjJMx6fgSqDGtUB1WBMHFk4lEX5Q.jar
Jan 27, 2023 2:20:12 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 488 files cached, 4 files newly uploaded in 1
seconds
Jan 27, 2023 2:20:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Jan 27, 2023 2:20:12 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <388603 bytes, hash
1c03c3d05f5dc4cb2a078a05e5a3a356d604e8bded674e40f25a639bdb9963f9> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-HAPD0F9dxMsqB4oF5aOjVtYE6L3tZ05A8lpjm9uZY_k.pb
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce db rows as step s2
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Pair with random key as step s3
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before
writing/Reshuffle/Window.Into()/Window.Assign as step s4
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Reshuffle/GroupByKey as step s5
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Reshuffle/ExpandIterable as step
s6
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Values/Values/Map as step s7
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect write time as step s8
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Construct rows for DBOutputFormat as step s9
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/CreateOutputConfig/Read(CreateSource) as step s10
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s11
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s12
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s13
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s14
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s15
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s16
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s17
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
as step s18
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop OutputFormat/ParDo(SetupJob) as step s19
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/GroupDataByPartition/AssignTask as step s20
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/GroupDataByPartition/GroupByTaskId as step s21
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/GroupDataByPartition/FlattenGroupedTasks as step s22
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop OutputFormat/Write as step s23
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/CollectWriteTasks/WithKeys/AddKeys/Map as step s24
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/CollectWriteTasks/Combine.perKey(IterableCombiner)/GroupByKey as
step s25
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/CollectWriteTasks/Combine.perKey(IterableCombiner)/Combine.GroupedValues
as step s26
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop
OutputFormat/CollectWriteTasks/Values/Values/Map as step s27
Jan 27, 2023 2:20:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using Hadoop OutputFormat/CommitWriteJob as step s28
Jan 27, 2023 2:20:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.46.0-SNAPSHOT
Jan 27, 2023 2:20:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-27_06_20_17-2708199873591907557?project=apache-beam-testing
Jan 27, 2023 2:20:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-27_06_20_17-2708199873591907557
Jan 27, 2023 2:20:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-01-27_06_20_17-2708199873591907557
Jan 27, 2023 2:20:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-27T14:20:21.427Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
hadoopformatioit0writeandreadusinghadoopformat-jenkins-012-5z5o. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 27, 2023 2:20:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:20:46.239Z: Worker configuration: e2-standard-2 in
us-central1-f.
Jan 27, 2023 2:20:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-27T14:20:47.335Z: Workflow failed. Causes: The quota check
has failed., Requested quota metric SSD Total GB is currently unavailable.
Jan 27, 2023 2:20:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:20:47.374Z: Cleaning up.
Jan 27, 2023 2:20:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:20:47.427Z: Worker pool stopped.
Jan 27, 2023 2:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:20:50.689Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 27, 2023 2:20:57 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-01-27_06_20_17-2708199873591907557 failed with status FAILED.
Jan 27, 2023 2:20:58 PM org.apache.beam.runners.dataflow.DataflowRunner
validateSdkContainerImageOptions
WARNING: Prefer --sdkContainerImage over deprecated legacy option
--****HarnessContainerImage.
Jan 27, 2023 2:20:58 PM
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory
tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket:
dataflow-staging-us-central1-844138762903
Jan 27, 2023 2:20:58 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 409, performed 0 retries due to
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP
framework says request can be retried, (caller responsible for retrying):
https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Jan 27, 2023 2:20:58 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Jan 27, 2023 2:20:59 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 492 files. Enable logging at DEBUG level to see
which files will be staged.
Jan 27, 2023 2:20:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Jan 27, 2023 2:21:02 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 492 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Jan 27, 2023 2:21:02 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.46.0-SNAPSHOT-wq0zWvhONI8axxgtDkOzsTBUT57aW5LBBFFf8RIaXA8.jar
Jan 27, 2023 2:21:03 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 492 files cached, 0 files newly uploaded in 0
seconds
Jan 27, 2023 2:21:03 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Jan 27, 2023 2:21:03 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <268789 bytes, hash
dec452d011878003e4b89fc99b51c4dac9166f63c0fe61a1f9b3e157f6c156d4> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-3sRS0BGHgAPkuJ_Jm1HE2skWb2PA_mGh-bPhV_bBVtQ.pb
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read using Hadoop
InputFormat/Read(HadoopInputFormatBoundedSource) as step s1
Jan 27, 2023 2:21:07 PM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect read time as step s2
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Get values only/Values/Map as step s3
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Values as string as step s4
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/WithKeys/AddKeys/Map as step s5
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Combine.perKey(Hashing)/GroupByKey as step
s6
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues as step s7
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Values/Values/Map as step s8
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as step s9
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/View.AsIterable/CreateDataflowView as step
s10
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/CreateVoid/Read(CreateSource) as step s11
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/ProduceDefault as step s12
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Flatten.PCollections as step s13
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) as step
s14
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) as step s15
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/Read(CreateSource) as
step s16
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Flatten.PCollections as step s17
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Window.Into()/Flatten.PCollections as
step s18
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/WithKeys/AddKeys/Map as step s19
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/GroupByKey as step s20
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Values/Values/Map as step s21
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(Concat) as step s22
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GetPane/Map as step s23
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/RunChecks as step s24
Jan 27, 2023 2:21:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/VerifyAssertions/ParDo(DefaultConclude) as step s25
Jan 27, 2023 2:21:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.46.0-SNAPSHOT
Jan 27, 2023 2:21:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-27_06_21_07-439631263652626248?project=apache-beam-testing
Jan 27, 2023 2:21:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-27_06_21_07-439631263652626248
Jan 27, 2023 2:21:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-01-27_06_21_07-439631263652626248
Jan 27, 2023 2:21:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-27T14:21:13.217Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
hadoopformatioit0writeandreadusinghadoopformat-jenkins-012-ipqk. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 27, 2023 2:21:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:21:41.959Z: Worker configuration: e2-standard-2 in
us-central1-f.
Jan 27, 2023 2:21:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-27T14:21:43.135Z: Workflow failed. Causes: The quota check
has failed., Requested quota metric SSD Total GB is currently unavailable.
Jan 27, 2023 2:21:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:21:43.184Z: Cleaning up.
Jan 27, 2023 2:21:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:21:43.253Z: Worker pool stopped.
Jan 27, 2023 2:21:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-27T14:21:44.659Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 27, 2023 2:21:50 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-01-27_06_21_07-439631263652626248 failed with status FAILED.
org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT >
writeAndReadUsingHadoopFormat STANDARD_OUT
Load test results for test (ID): 8a9a9115-14e7-4392-916a-cafbba22c881 and
timestamp: 2023-01-27T14:21:50.615000000Z:
Metric: Value:
read_time 0.0
Load test results for test (ID): 8a9a9115-14e7-4392-916a-cafbba22c881 and
timestamp: 2023-01-27T14:21:50.615000000Z:
Metric: Value:
data_size 0.0
write_time 0.0
org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT >
writeAndReadUsingHadoopFormat FAILED
java.lang.AssertionError: Values should be different. Actual: FAILED
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failEquals(Assert.java:187)
at org.junit.Assert.assertNotEquals(Assert.java:163)
at org.junit.Assert.assertNotEquals(Assert.java:177)
at
org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT.writeAndReadUsingHadoopFormat(HadoopFormatIOIT.java:233)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:hadoop-format:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.033 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/reports/tests/integrationTest>
:sdks:java:io:hadoop-format:integrationTest (Thread[included builds,5,main])
completed. Took 1 mins 58.016 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:hadoop-format:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 27s
143 actionable tasks: 85 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bglekdgsku6yu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
