See
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/6240/display/redirect?page=changes>
Changes:
[ningkang0957] Prep sidepanel 3.0.0 release
[noreply] Fix go fmt error (#23474)
[noreply] Revert "Add drop_example flag to the RunInference and Model Handler
[noreply] Documented supported PyTorch versions (#22974)
[noreply] [Go SDK] Add fake impulse for inputs in Xlang Transform (#23383)
[noreply] Write permissions for issue closer/assigner
[noreply] GA Migration Adding Removal of /.m2/settings.xml (#23481)
------------------------------------------
[...truncated 390.85 KB...]
INFO: No stagingLocation provided, falling back to gcpTempLocation
Oct 04, 2022 7:23:47 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 419 files. Enable logging at DEBUG level to see
which files will be staged.
Oct 04, 2022 7:23:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Oct 04, 2022 7:23:52 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 420 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Oct 04, 2022 7:23:52 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.43.0-SNAPSHOT-SdARy_HvySN5Hf_sPn3Pbq9Dz-CwlnVUjc_wQ_CFZTI.jar
Oct 04, 2022 7:23:52 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test4153706623322317286.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-RxSNoR_F9JbTirT1t_IoMPxC-cLwkLzrrCpywCEoMyw.jar
Oct 04, 2022 7:23:52 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test5225290748267678054.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-0BlQaHHrpjrNvXl1tCCNs57gKX_OV1mR6fB_KVHkNBc.jar
Oct 04, 2022 7:23:53 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 418 files cached, 2 files newly uploaded in 0
seconds
Oct 04, 2022 7:23:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Oct 04, 2022 7:23:53 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <435998 bytes, hash
e903af6c0b8b9ade6520eee56a5dcb27f4dd12afcf291d60c35537c35cf9043c> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-6QOvbAuLmt5lIO7lal3LJ_TdEq_PKR1gw1U3w1z5BDw.pb
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce text lines as step s2
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce Avro records as step s3
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather write start times as step s4
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles as step
s5
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step s6
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step s7
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum as step s8
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as step
s9
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Add void
key/AddKeys/Map as step s10
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign as
step s11
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey as step s12
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable as step s13
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Drop
key/Values/Map as step s14
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Gather
bundles as step s15
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key as step s16
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s17
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s18
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s19
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
as step s20
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Finalize as step s21
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key as step s22
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s23
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s24
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s25
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
as step s26
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather write end times as step s27
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Get file names/Values/Map as step s28
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Match filepatterns as step s29
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Pair with random key as step
s30
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s31
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as step
s32
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as
step s33
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Values/Values/Map as step s34
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read matched files/ParDo(ToReadableFile) as step s35
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather read start time as step s36
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Pair
with initial restriction as step s37
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Split restriction as step s38
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Explode windows as step s39
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Assign unique key/AddKeys/Map as
step s40
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/Window.Into()/Window.Assign
as step s41
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/GroupByKey
as step s42
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/ExpandIterable
as step s43
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Drop
key/Values/Map as step s44
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/NaiveProcess
as step s45
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather read end time as step s46
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s47
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/WithKeys/AddKeys/Map as step s48
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Combine.perKey(Hashing)/GroupByKey as step
s49
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues as step s50
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Values/Values/Map as step s51
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as step s52
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/View.AsIterable/CreateDataflowView as step
s53
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/CreateVoid/Read(CreateSource) as step s54
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/ProduceDefault as step s55
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Flatten.PCollections as step s56
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) as step
s57
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) as step s58
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/Read(CreateSource) as
step s59
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Flatten.PCollections as step s60
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Window.Into()/Flatten.PCollections as
step s61
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/WithKeys/AddKeys/Map as step s62
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/GroupByKey as step s63
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Values/Values/Map as step s64
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(Concat) as step s65
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GetPane/Map as step s66
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/RunChecks as step s67
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/VerifyAssertions/ParDo(DefaultConclude) as step s68
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s69
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s70
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s71
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s72
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s73
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s74
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s75
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView as step s76
Oct 04, 2022 7:23:56 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Delete test files as step s77
Oct 04, 2022 7:23:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.43.0-SNAPSHOT
Oct 04, 2022 7:23:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-10-04_12_23_56-11588021255219372649?project=apache-beam-testing
Oct 04, 2022 7:23:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-10-04_12_23_56-11588021255219372649
Oct 04, 2022 7:23:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2022-10-04_12_23_56-11588021255219372649
Oct 04, 2022 7:24:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-04T19:24:16.671Z: Worker configuration: e2-standard-2 in
us-central1-a.
Oct 04, 2022 7:24:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-04T19:24:18.903Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 04, 2022 7:24:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-04T19:24:19.646Z: Workflow failed. Causes: Project
apache-beam-testing has insufficient quota(s) to execute this workflow with 1
instances in region us-central1. Quota summary (required/available): 1/38750
instances, 2/1213 CPUs, 25/340050 disk GB, 0/764 SSD disk GB, 1/270 instance
groups, 1/273 managed instance groups, 1/437 instance templates, 1/0 in-use IP
addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about
requesting more quota.
Oct 04, 2022 7:24:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-04T19:24:19.693Z: Cleaning up.
Oct 04, 2022 7:24:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-04T19:24:19.752Z: Worker pool stopped.
Oct 04, 2022 7:24:31 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-10-04_12_23_56-11588021255219372649 failed with status
FAILED.
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll STANDARD_OUT
Load test results for test (ID): 67e408ec-6b16-48f0-bf31-436de49be19d and
timestamp: 2022-10-04T19:24:31.498000000Z:
Metric: Value:
run_time 0.0
dataset_size 1.08737E9
read_time 0.0
write_time 0.0
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll FAILED
java.lang.AssertionError: Values should be different. Actual: FAILED
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failEquals(Assert.java:187)
at org.junit.Assert.assertNotEquals(Assert.java:163)
at org.junit.Assert.assertNotEquals(Assert.java:177)
at
org.apache.beam.sdk.io.parquet.ParquetIOIT.writeThenReadAll(ParquetIOIT.java:171)
1 test completed, 1 failed
Finished generating test XML results (0.026 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** Thread
3,5,main]) completed. Took 53.016 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 20s
153 actionable tasks: 91 executed, 60 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wl3qsdvt2f3vy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
