See
<https://ci-beam.apache.org/job/beam_PerformanceTests_BiqQueryIO_Batch_Java_Avro/482/display/redirect>
Changes:
------------------------------------------
[...truncated 367.62 KB...]
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s11
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s12
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s13
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
as step s14
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdCreationRoot_TEMP_TABLE_LOAD/Read(CreateSource) as step s15
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/CreateJobId_TEMP_TABLE_LOAD as step s16
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s17
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s18
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s19
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s20
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s21
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s22
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s23
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
as step s24
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdCreationRoot_SCHEMA_UPDATE/Read(CreateSource) as step s25
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/CreateJobId_SCHEMA_UPDATE as step s26
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s27
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s28
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s29
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s30
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s31
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s32
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s33
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_SCHEMA_UPDATE/Combine.GloballyAsSingletonView/CreateDataflowView
as step s34
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdCreationRoot_COPY/Read(CreateSource) as step s35
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/CreateJobId_COPY as step s36
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s37
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s38
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s39
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s40
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s41
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s42
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s43
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/CreateDataflowView
as step s44
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/Create dummy value/Read(CreateSource)
as step s45
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/GetTempFilePrefix as step s46
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s47
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s48
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s49
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s50
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s51
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s52
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s53
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/CreateDataflowView
as step s54
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/rewindowIntoGlobal/Window.Assign as
step s55
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/WriteBundlesToFiles as step s56
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/GroupByDestination as step s57
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/StripShardId/Map as step s58
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/WriteGroupedRecords as step s59
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/FlattenFiles as step s60
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as
step s61
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyResults/View.AsIterable/CreateDataflowView as step s62
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyResults/Create.Values/Read(CreateSource) as step s63
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/ReifyResults/ParDo(Anonymous) as step
s64
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/WritePartitionUntriggered as step s65
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign as step s66
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey as
step s67
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionsReshuffle/ExpandIterable as step s68
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables) as step s69
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map as step s70
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign as step s71
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey
as step s72
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionWriteTables/Values/Values/Map as step s73
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles) as
step s74
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/Keys/Keys/Map as step s75
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/Convert to TableDestinations as step s76
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign as step s77
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey as
step s78
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/MultiPartitionsReshuffle/ExpandIterable
as step s79
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables) as step s80
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map as step s81
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign as step s82
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey
as step s83
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map as step s84
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles) as
step s85
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
as step s86
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyRenameInput/View.AsIterable/CreateDataflowView as step s87
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource) as step s88
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/ReifyRenameInput/ParDo(Anonymous) as
step s89
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/ParDo(UpdateSchemaDestination) as step
s90
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/WriteRenameUntriggered as step s91
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to BQ/BatchLoads/Flatten.PCollections as step s92
Feb 25, 2023 10:18:08 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to
BQ/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource) as step s93
Feb 25, 2023 10:18:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.47.0-SNAPSHOT
Feb 25, 2023 10:18:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-02-25_14_18_08-14521170863534101862?project=apache-beam-testing
Feb 25, 2023 10:18:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-02-25_14_18_08-14521170863534101862
Feb 25, 2023 10:18:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-02-25_14_18_08-14521170863534101862
Feb 25, 2023 10:18:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-02-25T22:18:10.989Z: The requested max number of ****s (5) is
ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Feb 25, 2023 10:18:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:14.114Z: Staged package
commons-digester-2.1-4LK5gKhPxlM8XOKR8ZF7MsUH9ivK1kGY__RDaMIZaj0.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/commons-digester-2.1-4LK5gKhPxlM8XOKR8ZF7MsUH9ivK1kGY__RDaMIZaj0.jar'
is inaccessible.
Feb 25, 2023 10:18:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:14.246Z: Staged package
commons-validator-1.7-TXT0zk-2iyYX7a0Ibfbe_fkzhGfSN30sYuaQOOHE8C8.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/commons-validator-1.7-TXT0zk-2iyYX7a0Ibfbe_fkzhGfSN30sYuaQOOHE8C8.jar'
is inaccessible.
Feb 25, 2023 10:18:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:14.533Z: Staged package
everit-json-schema-1.14.1-EgG9-SC3fZoyOAliWOdj6zJmIktwEt_oxN68PcI4gUU.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/everit-json-schema-1.14.1-EgG9-SC3fZoyOAliWOdj6zJmIktwEt_oxN68PcI4gUU.jar'
is inaccessible.
Feb 25, 2023 10:18:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:16.379Z: Staged package
handy-uri-templates-2.1.8-a4OEby_2HQqqZpl7ZLiD7HtlzxO1Ck1_WCUJltQpvi4.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/handy-uri-templates-2.1.8-a4OEby_2HQqqZpl7ZLiD7HtlzxO1Ck1_WCUJltQpvi4.jar'
is inaccessible.
Feb 25, 2023 10:18:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:16.988Z: Staged package
json-20220320-Ht9_zqeaFrjf3TvJiN3sf4kIsfd2L98A05rLA3VCdHo.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/json-20220320-Ht9_zqeaFrjf3TvJiN3sf4kIsfd2L98A05rLA3VCdHo.jar'
is inaccessible.
Feb 25, 2023 10:18:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-02-25T22:18:19.074Z: Workflow failed. Causes: One or more
access checks for temp location or staged files failed. Please refer to other
error messages for details. For more information on security and permissions,
please see https://cloud.google.com/dataflow/security-and-permissions.
Feb 25, 2023 10:18:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-25T22:18:19.106Z: Cleaning up.
Feb 25, 2023 10:18:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-25T22:18:19.159Z: Worker pool stopped.
Feb 25, 2023 10:18:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-25T22:18:20.379Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Feb 25, 2023 10:18:44 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-02-25_14_18_08-14521170863534101862 failed with status
FAILED.
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > testWriteThenRead
STANDARD_OUT
Load test results for test (ID): 3982390f-5594-44ee-b1bc-40058090ca5f and
timestamp: 2023-02-25T22:17:54.189000000Z:
Metric: Value:
avro_write_time 0.0
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > testWriteThenRead FAILED
java.lang.AssertionError: Values should be different. Actual: FAILED
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failEquals(Assert.java:187)
at org.junit.Assert.assertNotEquals(Assert.java:163)
at org.junit.Assert.assertNotEquals(Assert.java:177)
at
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.testWrite(BigQueryIOIT.java:207)
at
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.testAvroWrite(BigQueryIOIT.java:172)
at
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.testWriteThenRead(BigQueryIOIT.java:139)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_BiqQueryIO_Batch_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.027 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_BiqQueryIO_Batch_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest>
:sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution ****
Thread 7,5,main]) completed. Took 53.365 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:java:io:bigquery-io-perf-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_BiqQueryIO_Batch_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 22s
144 actionable tasks: 86 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/e6v624oeulijq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
