See
<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/4127/display/redirect?page=changes>
Changes:
[noreply] Improved test coverage and fix the implementation of Inject and CoGBK
[noreply] Fix python log_level_overrides cannot be used on flink and other
[noreply] Better error for disabling runner v2 with cross language pipelines.
------------------------------------------
[...truncated 394.80 KB...]
INFO: 2022-10-18T03:32:11.610Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify into Write to
BQ/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.650Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write into Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.686Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow into Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.721Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsReshuffle/ExpandIterable into Write to
BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.753Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables) into Write to
BQ/BatchLoads/MultiPartitionsReshuffle/ExpandIterable
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.781Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map into Write to
BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.811Z: Fusing consumer Write to
BQ/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into Write to BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.844Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign into Write
to BQ/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.873Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify into Write to
BQ/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.909Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write into Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.944Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow into Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:11.974Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map into Write to
BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.005Z: Fusing consumer Write to
BQ/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
into Write to BQ/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.036Z: Fusing consumer Write to
BQ/BatchLoads/ReifyRenameInput/ParDo(Anonymous) into Write to
BQ/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.072Z: Fusing consumer Write to
BQ/BatchLoads/ParDo(UpdateSchemaDestination) into Write to
BQ/BatchLoads/ReifyRenameInput/ParDo(Anonymous)
Oct 18, 2022 3:32:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.107Z: Fusing consumer Write to
BQ/BatchLoads/WriteRenameUntriggered into Write to
BQ/BatchLoads/ParDo(UpdateSchemaDestination)
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.541Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.573Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.602Z: Starting 5 ****s in us-central1-b...
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.614Z: Executing operation Write to
BQ/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.636Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.651Z: Finished operation Write to
BQ/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.827Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.833Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.837Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:12.987Z: Executing operation Write to
BQ/BatchLoads/JobIdCreationRoot_LOAD/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_LOAD+Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:13.020Z: Executing operation Write to
BQ/BatchLoads/JobIdCreationRoot_TEMP_TABLE_LOAD/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_TEMP_TABLE_LOAD+Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:32:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:13.051Z: Executing operation Write to
BQ/BatchLoads/JobIdCreationRoot_COPY/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_COPY+Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:32:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:35.044Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 18, 2022 3:32:55 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:32:54.455Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Oct 18, 2022 3:33:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:28.056Z: Workers have started successfully.
Oct 18, 2022 3:33:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:48.733Z: Finished operation Write to
BQ/BatchLoads/JobIdCreationRoot_LOAD/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_LOAD+Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:33:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:48.818Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.647Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.710Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.842Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.899Z: Finished operation Write to
BQ/BatchLoads/JobIdCreationRoot_COPY/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_COPY+Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.972Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:49.999Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:50.663Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:50.728Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:50.863Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:50.910Z: Finished operation Write to
BQ/BatchLoads/JobIdCreationRoot_TEMP_TABLE_LOAD/Read(CreateSource)+Write to
BQ/BatchLoads/CreateJobId_TEMP_TABLE_LOAD+Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:50.983Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.017Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.041Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.094Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.237Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.344Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.530Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.627Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.683Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:51.758Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.689Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.828Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.848Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.915Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.920Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:54.962Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.018Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.053Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.087Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.156Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.193Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.203Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.285Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:55.318Z: Executing operation Write to
BQ/BatchLoads/Create dummy value/Read(CreateSource)+Write to
BQ/BatchLoads/GetTempFilePrefix+Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.251Z: Finished operation Write to
BQ/BatchLoads/Create dummy value/Read(CreateSource)+Write to
BQ/BatchLoads/GetTempFilePrefix+Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.310Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.782Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.804Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.842Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.936Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.977Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:57.992Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_COPY/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:58.112Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:58.703Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:33:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:58.821Z: Executing operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:34:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:58.906Z: Finished operation Write to
BQ/BatchLoads/JobIdSideInput_TEMP_TABLE_LOAD/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:34:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:59.331Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 18, 2022 3:34:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:59.394Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:34:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:59.451Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 18, 2022 3:34:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:33:59.516Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.014Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Write
to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.140Z: Executing operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.201Z: Finished operation Write to
BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.340Z: Executing operation Write to
BQ/BatchLoads/GroupByDestination/Create
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.495Z: Finished operation Write to
BQ/BatchLoads/GroupByDestination/Create
Oct 18, 2022 3:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-18T03:34:02.649Z: Executing operation Read from source+Gather
time+Map records+Write to BQ/PrepareWrite/ParDo(Anonymous)+Write to
BQ/BatchLoads/rewindowIntoGlobal/Window.Assign+Write to
BQ/BatchLoads/WriteBundlesToFiles+Write to
BQ/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Write
to BQ/BatchLoads/GroupByDestination/Reify+Write to
BQ/BatchLoads/GroupByDestination/Write
org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > testWriteThenRead SKIPPED
> Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED
:sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution ****
Thread 6,5,main]) completed. Took 4 mins 5.544 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:java:io:bigquery-io-perf-tests:integrationTest'.
> Process 'Gradle Test Executor 2' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.5.1/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 19s
137 actionable tasks: 81 executed, 54 from cache, 2 up-to-date
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=ba4ad1a1-58ee-47a4-ae1c-6c9c44de48b0,
currentDir=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1181770
log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-1181770.out.log
----- Last 20 lines from daemon log file - daemon-1181770.out.log -----
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.5.1/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 19s
137 actionable tasks: 81 executed, 54 from cache, 2 up-to-date
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
