See
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/7250/display/redirect?page=changes>
Changes:
[noreply] [RRIO] [Throttle] Stub throttle without external transform (#29059)
------------------------------------------
[...truncated 294.27 KB...]
INFO: No stagingLocation provided, falling back to gcpTempLocation
Oct 23, 2023 10:24:14 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 381 files. Enable logging at DEBUG level to see
which files will be staged.
Oct 23, 2023 10:24:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Oct 23, 2023 10:24:19 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 382 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Oct 23, 2023 10:24:19 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.52.0-SNAPSHOT-AyAeH2yW7aJa806naXJlOrKeypfsPMauoNVRiWq_OA8.jar
Oct 23, 2023 10:24:19 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test1454104166364460343.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-FCECt9wkyqEnopPix1_JlCwmF3A4DhhYLImAri1Su98.jar
Oct 23, 2023 10:24:19 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test7082424571713162268.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-C4YvuwVSGcFmk0B-Se32uHEwYXUW8RzzQALQiI32jn8.jar
Oct 23, 2023 10:24:20 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 380 files cached, 2 files newly uploaded in 1
seconds
Oct 23, 2023 10:24:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Oct 23, 2023 10:24:20 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <408709 bytes, hash
dce28b7aea57afaa476a269e01e3976baf722634c8f2f49990f03ebbd9b4c395> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-3OKLeupXr6pHaiaeAeOXa69yJjTI8vSZkPA-u9m0w5U.pb
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce text lines as step s2
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce Avro records as step s3
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather write start times as step s4
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles as step
s5
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step s6
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step s7
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum as step s8
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as step
s9
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Add void
key/AddKeys/Map as step s10
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign as
step s11
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey as step s12
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable as step s13
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Drop
key/Values/Map as step s14
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet files/WriteFiles/GatherTempFileResults/Gather
bundles as step s15
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key as step s16
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s17
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s18
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s19
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
as step s20
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Finalize as step s21
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key as step s22
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s23
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s24
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s25
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Parquet
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
as step s26
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather write end times as step s27
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Get file names/Values/Map as step s28
Oct 23, 2023 10:24:24 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Match filepatterns as step s29
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Pair with random key as step
s30
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s31
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as step
s32
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as
step s33
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Find files/Reshuffle.ViaRandomKey/Values/Values/Map as step s34
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read matched files/ParDo(ToReadableFile) as step s35
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather read start time as step s36
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Pair
with initial restriction as step s37
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Split restriction as step s38
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Explode windows as step s39
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/Assign unique key/AddKeys/Map as
step s40
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/Window.Into()/Window.Assign
as step s41
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/GroupByKey
as step s42
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Reshuffle/ExpandIterable
as step s43
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/Drop
key/Values/Map as step s44
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read parquet
files/ParDo(SplitRead)/ParMultiDo(SplitRead)/ProcessKeyedElements/NaiveProcess
as step s45
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Gather read end time as step s46
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s47
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/WithKeys/AddKeys/Map as step s48
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Combine.perKey(Hashing)/GroupByKey as step
s49
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues as step s50
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Values/Values/Map as step s51
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as step s52
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/View.AsIterable/CreateDataflowView as step
s53
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/CreateVoid/Impulse as step s54
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/CreateVoid/MapElements/Map as step s55
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/ProduceDefault as step s56
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Flatten.PCollections as step s57
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) as step
s58
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) as step s59
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/Impulse as step s60
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/MapElements/Map as step
s61
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Flatten.PCollections as step s62
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Window.Into()/Flatten.PCollections as
step s63
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/WithKeys/AddKeys/Map as step s64
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/GroupByKey as step s65
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Values/Values/Map as step s66
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(Concat) as step s67
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GetPane/Map as step s68
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/RunChecks as step s69
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/VerifyAssertions/ParDo(DefaultConclude) as step s70
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s71
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s72
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s73
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s74
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s75
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s76
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s77
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView as step s78
Oct 23, 2023 10:24:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Delete test files as step s79
Oct 23, 2023 10:24:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.52.0-SNAPSHOT
Oct 23, 2023 10:24:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-10-23_15_24_25-11431152402153725434?project=apache-beam-testing
Oct 23, 2023 10:24:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-10-23_15_24_25-11431152402153725434
Oct 23, 2023 10:24:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-10-23_15_24_25-11431152402153725434
Oct 23, 2023 10:24:44 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-10-23T22:24:42.615Z: Worker configuration: e2-standard-2 in
us-central1-b.
Oct 23, 2023 10:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-10-23T22:24:44.319Z: Workflow failed. Causes: Project
apache-beam-testing has insufficient resource(s) to execute this workflow with
1 instances in region us-central1. Resource summary (required/available):
1/39233 instances, 2/1822 CPUs, 0/0 Unknown GPUs, 25/1 disk GB, 0/10653 SSD
disk GB, 1/233 instance groups, 1/241 managed instance groups, 1/381 instance
templates, 1/462 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about
requesting more quota.
Oct 23, 2023 10:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-10-23T22:24:44.342Z: Cleaning up.
Oct 23, 2023 10:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-10-23T22:24:44.382Z: Worker pool stopped.
Oct 23, 2023 10:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-10-23T22:24:45.571Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 23, 2023 10:24:58 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-10-23_15_24_25-11431152402153725434 failed with status
FAILED.
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll STANDARD_OUT
Load test results for test (ID): 37c73d69-9267-4208-bfe9-7394815b5fd7 and
timestamp: 2023-10-23T22:24:58.827000000Z:
Metric: Value:
write_time 0.0
run_time 0.0
read_time 0.0
dataset_size 1.08737E9
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll STANDARD_ERROR
ERROR StatusLogger Log4j2 could not find a logging implementation. Please
add log4j-core to the classpath. Using SimpleLogger to log to the console...
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll FAILED
java.lang.AssertionError: Values should be different. Actual: FAILED
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failEquals(Assert.java:187)
at org.junit.Assert.assertNotEquals(Assert.java:163)
at org.junit.Assert.assertNotEquals(Assert.java:177)
at
org.apache.beam.sdk.io.parquet.ParquetIOIT.writeThenReadAll(ParquetIOIT.java:171)
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 1m 30s
154 actionable tasks: 93 executed, 61 from cache
Publishing build scan...
https://ge.apache.org/s/2wgovpv2iwjes
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
