See <https://ci-beam.apache.org/job/beam_python_mongoio_load_test/3575/display/redirect?page=changes>
Changes: [dannymccormick] Gather metrics on GH Issues [dannymccormick] Fixes [dannymccormick] Fixes [dannymccormick] Comment + naming fix [dannymccormick] Conflicts fix [dannymccormick] Ordering [dannymccormick] Different fallback for prs/issues [noreply] Add ability to self-assign issues for non-committers (#21719) [dannymccormick] Fix sync time [noreply] Dont try to generate jiras as part of dependency report (#21753) [noreply] Allow users to comment `.take-issue` without taking (#21755) ------------------------------------------ [...truncated 58.78 KB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:49.787Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.016Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.055Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.087Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/KeyWithVoid into Map INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.130Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/KeyWithVoid into Map INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.170Z: JOB_MESSAGE_DETAILED: Fusing consumer Map into ReadFromMongoDB/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.202Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial into Count/CombineGlobally(CountCombineFn)/KeyWithVoid INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.255Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.295Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.320Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.351Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract into Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.380Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/UnKey into Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.420Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial into Combine/KeyWithVoid INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.469Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey/Reify into Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.507Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey/Write into Combine/CombinePerKey/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.542Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/Combine into Combine/CombinePerKey/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.581Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/Combine/Extract into Combine/CombinePerKey/Combine INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.617Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/UnKey into Combine/CombinePerKey/Combine/Extract INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.649Z: JOB_MESSAGE_DETAILED: Unzipping flatten s23 for input s21.None INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.684Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten, into producer assert_that/Group/CoGroupByKeyImpl/Tag[0] INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.718Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow into assert_that/Group/CoGroupByKeyImpl/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.749Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) into assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.792Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/RestoreTags into assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.868Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/RestoreTags INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.950Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:50.985Z: JOB_MESSAGE_DETAILED: Unzipping flatten s23-u49 for input s24-reify-value27-c47 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.021Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten/Unzipped-1, into producer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.047Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify into assert_that/Group/CoGroupByKeyImpl/Tag[1] INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.083Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write into assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.146Z: JOB_MESSAGE_DETAILED: Unzipping flatten s17 for input s16.None INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.172Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/WindowInto(WindowIntoFn), through flatten Flatten, into producer Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.217Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[0] into assert_that/Create/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.251Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[1] into assert_that/ToVoidKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.280Z: JOB_MESSAGE_DETAILED: Unzipping flatten s17-u56 for input s19.None-c54 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.313Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/ToVoidKey, through flatten Flatten/Unzipped-1, into producer assert_that/WindowInto(WindowIntoFn) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.343Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into Combine/InjectDefault/InjectDefault INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.409Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.449Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault into Count/CombineGlobally(CountCombineFn)/DoOnce/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.483Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/InjectDefault/InjectDefault into Combine/DoOnce/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.538Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.569Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.643Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.673Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.877Z: JOB_MESSAGE_DEBUG: Executing wait step start74 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:51.980Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:52.014Z: JOB_MESSAGE_BASIC: Executing operation Combine/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:52.022Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:52.057Z: JOB_MESSAGE_BASIC: Starting 5 workers in us-central1-b... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2022-06-08_13_55_37-11489547730534663358 is in state JOB_STATE_RUNNING INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:54.527Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:55:54.626Z: JOB_MESSAGE_DEBUG: Value "Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:02.097Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:04.529Z: JOB_MESSAGE_BASIC: Finished operation Combine/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:04.604Z: JOB_MESSAGE_DEBUG: Value "Combine/CombinePerKey/GroupByKey/Session" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:04.673Z: JOB_MESSAGE_BASIC: Executing operation ReadFromMongoDB/Read+Map+Count/CombineGlobally(CountCombineFn)/KeyWithVoid+Combine/KeyWithVoid+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial+Combine/CombinePerKey/GroupByKey/Reify+Combine/CombinePerKey/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:16.540Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running stage(s). INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:16.569Z: JOB_MESSAGE_DETAILED: Resized worker pool to 4, though goal was 5. This could be a quota issue. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:26.777Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running stage(s). INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:26.807Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:56:50.710Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:59:23.847Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:59:23.912Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T20:59:28.946Z: JOB_MESSAGE_DETAILED: Autoscaling: Resizing worker pool from 5 to 1. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:55.772Z: JOB_MESSAGE_BASIC: Finished operation ReadFromMongoDB/Read+Map+Count/CombineGlobally(CountCombineFn)/KeyWithVoid+Combine/KeyWithVoid+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial+Combine/CombinePerKey/GroupByKey/Reify+Combine/CombinePerKey/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:55.857Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:55.888Z: JOB_MESSAGE_BASIC: Executing operation Combine/CombinePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:55.913Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:55.978Z: JOB_MESSAGE_BASIC: Finished operation Combine/CombinePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:56.004Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Count/CombineGlobally(CountCombineFn)/UnKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:56.048Z: JOB_MESSAGE_BASIC: Executing operation Combine/CombinePerKey/GroupByKey/Read+Combine/CombinePerKey/Combine+Combine/CombinePerKey/Combine/Extract+Combine/UnKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.595Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Count/CombineGlobally(CountCombineFn)/UnKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.606Z: JOB_MESSAGE_BASIC: Finished operation Combine/CombinePerKey/GroupByKey/Read+Combine/CombinePerKey/Combine+Combine/CombinePerKey/Combine/Extract+Combine/UnKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.675Z: JOB_MESSAGE_DEBUG: Value "Combine/UnKey.out" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.707Z: JOB_MESSAGE_DEBUG: Value "Count/CombineGlobally(CountCombineFn)/UnKey.out" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.740Z: JOB_MESSAGE_BASIC: Executing operation Combine/InjectDefault/_UnpickledSideInput(UnKey.out.0) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.761Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/InjectDefault/_UnpickledSideInput(UnKey.out.0) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.805Z: JOB_MESSAGE_BASIC: Finished operation Combine/InjectDefault/_UnpickledSideInput(UnKey.out.0) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.845Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/InjectDefault/_UnpickledSideInput(UnKey.out.0) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.893Z: JOB_MESSAGE_DEBUG: Value "Combine/InjectDefault/_UnpickledSideInput(UnKey.out.0).output" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:02:59.957Z: JOB_MESSAGE_DEBUG: Value "Count/CombineGlobally(CountCombineFn)/InjectDefault/_UnpickledSideInput(UnKey.out.0).output" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.015Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.165Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.257Z: JOB_MESSAGE_DEBUG: Value "assert_that/Group/CoGroupByKeyImpl/GroupByKey/Session" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.344Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/DoOnce/Read+Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.376Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Read+assert_that/Group/CoGroupByKeyImpl/Tag[0]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:00.409Z: JOB_MESSAGE_BASIC: Executing operation Combine/DoOnce/Read+Combine/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:05.670Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/CoGroupByKeyImpl/Tag[0]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:08.881Z: JOB_MESSAGE_BASIC: Finished operation Combine/DoOnce/Read+Combine/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:09.057Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/DoOnce/Read+Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:09.140Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:09.201Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:09.279Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Read+assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow+assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values)+assert_that/Group/RestoreTags+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:11.670Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/CoGroupByKeyImpl/GroupByKey/Read+assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow+assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values)+assert_that/Group/RestoreTags+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:11.744Z: JOB_MESSAGE_DEBUG: Executing success step success72 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:11.843Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:11.901Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:11.979Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:36.990Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:37.037Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:37.068Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2022-06-08_13_55_37-11489547730534663358 is in state JOB_STATE_DONE INFO:__main__:Reading documents from mongodb finished in 493.103 seconds INFO:__main__:================================================================================ INFO:__main__:Reading from mongodb beam_mongodbio_it_db:integration_test_1654721167 INFO:__main__:reader params : {'filter': {'number_mod_3': 0}, 'projection': ['number']} INFO:__main__:expected results: {'number_sum': 166666833333, 'docs_count': 333334} INFO:apache_beam.runners.portability.stager:Copying Beam SDK "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. INFO:root:Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev INFO:root:Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python37:beam-master-20220512 INFO:root:Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python37:beam-master-20220512" for Docker environment INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fcb7108f950> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fcb7108e170> ==================== INFO:apache_beam.runners.dataflow.internal.apiclient:Defaulting to the temp_location as staging_location: gs://temp-storage-for-perf-tests/loadtests INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-0608210349-677144-9dhgym5v.1654722229.677551/dataflow_python_sdk.tar... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-0608210349-677144-9dhgym5v.1654722229.677551/dataflow_python_sdk.tar in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-0608210349-677144-9dhgym5v.1654722229.677551/pipeline.pb... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-0608210349-677144-9dhgym5v.1654722229.677551/pipeline.pb in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job clientRequestId: '20220608210349678393-6592' createTime: '2022-06-08T21:03:50.816225Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2022-06-08_14_03_50-16759465520331207908' location: 'us-central1' name: 'beamapp-jenkins-0608210349-677144-9dhgym5v' projectId: 'apache-beam-testing' stageStates: [] startTime: '2022-06-08T21:03:50.816225Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2022-06-08_14_03_50-16759465520331207908] INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2022-06-08_14_03_50-16759465520331207908 INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-06-08_14_03_50-16759465520331207908?project=apache-beam-testing INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2022-06-08_14_03_50-16759465520331207908 is in state JOB_STATE_PENDING INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:51.315Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2022-06-08_14_03_50-16759465520331207908. The number of workers will be between 1 and 1000. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:51.941Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2022-06-08_14_03_50-16759465520331207908. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:56.191Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.053Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.117Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step assert_that/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.196Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.233Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.439Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.485Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.515Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/KeyWithVoid into Map INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.556Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/KeyWithVoid into Map INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.587Z: JOB_MESSAGE_DETAILED: Fusing consumer Map into ReadFromMongoDB/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.619Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial into Count/CombineGlobally(CountCombineFn)/KeyWithVoid INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.652Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.684Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.726Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine into Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.819Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract into Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.859Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/UnKey into Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.892Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial into Combine/KeyWithVoid INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.928Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey/Reify into Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:57.964Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/GroupByKey/Write into Combine/CombinePerKey/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.002Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/Combine into Combine/CombinePerKey/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.024Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/CombinePerKey/Combine/Extract into Combine/CombinePerKey/Combine INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.048Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/UnKey into Combine/CombinePerKey/Combine/Extract INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.112Z: JOB_MESSAGE_DETAILED: Unzipping flatten s23 for input s21.None INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.146Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten, into producer assert_that/Group/CoGroupByKeyImpl/Tag[0] INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.177Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow into assert_that/Group/CoGroupByKeyImpl/GroupByKey/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.210Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) into assert_that/Group/CoGroupByKeyImpl/GroupByKey/GroupByWindow INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.241Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/RestoreTags into assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.275Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/RestoreTags INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.301Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.332Z: JOB_MESSAGE_DETAILED: Unzipping flatten s23-u49 for input s24-reify-value27-c47 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.361Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten/Unzipped-1, into producer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.412Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify into assert_that/Group/CoGroupByKeyImpl/Tag[1] INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.444Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write into assert_that/Group/CoGroupByKeyImpl/GroupByKey/Reify INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.477Z: JOB_MESSAGE_DETAILED: Unzipping flatten s17 for input s16.None INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.512Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/WindowInto(WindowIntoFn), through flatten Flatten, into producer Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.554Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[0] into assert_that/Create/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.587Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[1] into assert_that/ToVoidKey INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.610Z: JOB_MESSAGE_DETAILED: Unzipping flatten s17-u56 for input s19.None-c54 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.634Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/ToVoidKey, through flatten Flatten/Unzipped-1, into producer assert_that/WindowInto(WindowIntoFn) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.654Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into Combine/InjectDefault/InjectDefault INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.685Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.706Z: JOB_MESSAGE_DETAILED: Fusing consumer Count/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault into Count/CombineGlobally(CountCombineFn)/DoOnce/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.737Z: JOB_MESSAGE_DETAILED: Fusing consumer Combine/InjectDefault/InjectDefault into Combine/DoOnce/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.780Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.813Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.862Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:58.894Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.079Z: JOB_MESSAGE_DEBUG: Executing wait step start74 INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.156Z: JOB_MESSAGE_BASIC: Executing operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.189Z: JOB_MESSAGE_BASIC: Executing operation Combine/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.192Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.223Z: JOB_MESSAGE_BASIC: Starting 5 workers in us-central1-b... INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.973Z: JOB_MESSAGE_BASIC: Finished operation Combine/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:03:59.973Z: JOB_MESSAGE_BASIC: Finished operation Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:00.035Z: JOB_MESSAGE_DEBUG: Value "Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:00.068Z: JOB_MESSAGE_DEBUG: Value "Combine/CombinePerKey/GroupByKey/Session" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:00.166Z: JOB_MESSAGE_BASIC: Executing operation ReadFromMongoDB/Read+Map+Count/CombineGlobally(CountCombineFn)/KeyWithVoid+Combine/KeyWithVoid+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial+Combine/CombinePerKey/GroupByKey/Reify+Combine/CombinePerKey/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2022-06-08_14_03_50-16759465520331207908 is in state JOB_STATE_RUNNING INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.006Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-b failed to bring up any of the desired 5 workers. QUOTA_EXCEEDED: Instance 'beamapp-jenkins-060821034-06081403-jegs-harness-z85m' creation failed: Quota 'CPUS' exceeded. Limit: 4001.0 in region us-central1. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.038Z: JOB_MESSAGE_ERROR: Workflow failed. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.127Z: JOB_MESSAGE_BASIC: Finished operation ReadFromMongoDB/Read+Map+Count/CombineGlobally(CountCombineFn)/KeyWithVoid+Combine/KeyWithVoid+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Count/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify+Count/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Combine/CombinePerKey/GroupByKey+Combine/CombinePerKey/Combine/Partial+Combine/CombinePerKey/GroupByKey/Reify+Combine/CombinePerKey/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.226Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.284Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.316Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:22.531Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:33.820Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2022-06-08T21:04:33.862Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2022-06-08_14_03_50-16759465520331207908 is in state JOB_STATE_FAILED ERROR:apache_beam.runners.dataflow.dataflow_runner:Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2022-06-08_14_03_50-16759465520331207908?project=<ProjectId> Traceback (most recent call last): File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "/usr/lib/python3.7/runpy.py", line 85, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/io/mongodbio_it_test.py";,> line 170, in <module> run() File "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/io/mongodbio_it_test.py";,> line 157, in run assert_that(r, equal_to([expected['number_sum'], expected['docs_count']])) File "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/pipeline.py";,> line 596, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/testing/test_pipeline.py";,> line 116, in run state = result.wait_until_finish() File "<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py";,> line 1675, in wait_until_finish self) apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. > Task :sdks:python:test-suites:dataflow:py37:mongodbioIT FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 316 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:mongodbioIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 21m 14s 15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/iwnkqck2bo3j2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
