See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/6162/display/redirect?page=changes>
Changes: [zyichi] Update BigQuery source in bigquery_tornadoes example ------------------------------------------ [...truncated 13.29 MB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:31.996Z: JOB_MESSAGE_BASIC: Executing operation main input/Impulse+main input/FlatMap(<lambda at core.py:2644>)+main input/Map(decode)+Map(<lambda at sideinputs_test.py:287>)/Map(<lambda at sideinputs_test.py:287>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:31.996Z: JOB_MESSAGE_BASIC: Executing operation Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:32.025Z: JOB_MESSAGE_BASIC: Executing operation side list/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+side list/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+side list/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+side list/MaybeReshuffle/Reshuffle/RemoveRandomKeys+side list/Map(decode)+Map(<lambda at sideinputs_test.py:287>)/MapToVoidKey0+Map(<lambda at sideinputs_test.py:287>)/MapToVoidKey1+Map(<lambda at sideinputs_test.py:287>)/MapToVoidKey0+Map(<lambda at sideinputs_test.py:287>)/MapToVoidKey1+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey1.out.0)/PairWithVoidKey+Map(<lambda at sideinputs_test.py:287>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:38.404Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:38.409Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:38.953Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a. > Task :sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.050Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.050Z: JOB_MESSAGE_BASIC: Finished operation Impulse+Map(<lambda at ptransform_test.py:195>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.050Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.201Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.349Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.370Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.376Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:19.394Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.055Z: JOB_MESSAGE_BASIC: Finished operation Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 2/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 2/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.055Z: JOB_MESSAGE_BASIC: Finished operation Start 2/Impulse+Start 2/FlatMap(<lambda at core.py:2644>)+Start 2/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.055Z: JOB_MESSAGE_BASIC: Finished operation Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 1/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 1/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.056Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.056Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.058Z: JOB_MESSAGE_BASIC: Finished operation Start 1/Impulse+Start 1/FlatMap(<lambda at core.py:2644>)+Start 1/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.244Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.353Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.357Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.360Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:22.380Z: JOB_MESSAGE_BASIC: Stopping worker pool... > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.248Z: JOB_MESSAGE_BASIC: Finished operation Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start/Map(decode)+Do INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.249Z: JOB_MESSAGE_BASIC: Finished operation Start/Impulse+Start/FlatMap(<lambda at core.py:2644>)+Start/MaybeReshuffle/Reshuffle/AddRandomKeys+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.422Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.441Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.444Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.446Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.450Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.132Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.132Z: JOB_MESSAGE_BASIC: Finished operation Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Input/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Input/Map(decode)+ApplyPardo+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.132Z: JOB_MESSAGE_BASIC: Finished operation Input/Impulse+Input/FlatMap(<lambda at core.py:2644>)+Input/MaybeReshuffle/Reshuffle/AddRandomKeys+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.133Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.311Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.360Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.368Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.372Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:25.381Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.111Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Group/GroupByKey/ReadStream+assert:even/Group/GroupByKey/MergeBuckets+assert:even/Group/Map(_merge_tagged_vals_under_key)+assert:even/Unkey+assert:even/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.111Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Create/Impulse+assert:odd/Create/FlatMap(<lambda at core.py:2644>)+assert:odd/Create/Map(decode)+assert:odd/Group/pair_with_0+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.111Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Group/GroupByKey/ReadStream+assert:odd/Group/GroupByKey/MergeBuckets+assert:odd/Group/Map(_merge_tagged_vals_under_key)+assert:odd/Unkey+assert:odd/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.115Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Create/Impulse+assert:even/Create/FlatMap(<lambda at core.py:2644>)+assert:even/Create/Map(decode)+assert:even/Group/pair_with_0+assert:even/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.115Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.115Z: JOB_MESSAGE_BASIC: Finished operation Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start/Map(decode)+Map(split_even_odd)/Map(split_even_odd)+Flatten+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream+assert:even/WindowInto(WindowIntoFn)+assert:odd/WindowInto(WindowIntoFn)+assert:even/ToVoidKey+assert:even/Group/pair_with_1+assert:even/Group/GroupByKey/WriteStream+assert:odd/ToVoidKey+assert:odd/Group/pair_with_1+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.116Z: JOB_MESSAGE_BASIC: Finished operation Start/Impulse+Start/FlatMap(<lambda at core.py:2644>)+Start/MaybeReshuffle/Reshuffle/AddRandomKeys+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.120Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.260Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.345Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.353Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.362Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:26.385Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.722Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.722Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.722Z: JOB_MESSAGE_BASIC: Finished operation Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 3/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 3/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.723Z: JOB_MESSAGE_BASIC: Finished operation Start 2/Impulse+Start 2/FlatMap(<lambda at core.py:2644>)+Start 2/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.723Z: JOB_MESSAGE_BASIC: Finished operation Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 2/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 2/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.723Z: JOB_MESSAGE_BASIC: Finished operation Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 1/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 1/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.723Z: JOB_MESSAGE_BASIC: Finished operation Start 3/Impulse+Start 3/FlatMap(<lambda at core.py:2644>)+Start 3/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.723Z: JOB_MESSAGE_BASIC: Finished operation Start 1/Impulse+Start 1/FlatMap(<lambda at core.py:2644>)+Start 1/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.892Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.931Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.936Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.938Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.943Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 1/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 1/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation Start 1/Impulse+Start 1/FlatMap(<lambda at core.py:2644>)+Start 1/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation Start 2/Impulse+Start 2/FlatMap(<lambda at core.py:2644>)+Start 2/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.444Z: JOB_MESSAGE_BASIC: Finished operation Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 2/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 2/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.614Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.641Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.646Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.649Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:37.655Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.093Z: JOB_MESSAGE_BASIC: Finished operation Input/Impulse+Input/FlatMap(<lambda at core.py:2644>)+Input/MaybeReshuffle/Reshuffle/AddRandomKeys+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.093Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.093Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.093Z: JOB_MESSAGE_BASIC: Finished operation Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Input/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Input/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.271Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.526Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.554Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.564Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:43.588Z: JOB_MESSAGE_BASIC: Stopping worker pool... > Task :sdks:python:test-suites:dataflow:py36:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.381Z: JOB_MESSAGE_BASIC: Finished operation Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start/Map(decode)+Do INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.381Z: JOB_MESSAGE_BASIC: Finished operation Start/Impulse+Start/FlatMap(<lambda at core.py:2644>)+Start/MaybeReshuffle/Reshuffle/AddRandomKeys+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.543Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.566Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.570Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.572Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:29.577Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.205Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.205Z: JOB_MESSAGE_BASIC: Finished operation Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Input/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Input/Map(decode)+ApplyPardo+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.205Z: JOB_MESSAGE_BASIC: Finished operation Input/Impulse+Input/FlatMap(<lambda at core.py:2644>)+Input/MaybeReshuffle/Reshuffle/AddRandomKeys+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Input/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.205Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.367Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.473Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.491Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.501Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:28.524Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 2/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 2/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation Start 1/Impulse+Start 1/FlatMap(<lambda at core.py:2644>)+Start 1/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 1/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 1/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation Start 2/Impulse+Start 2/FlatMap(<lambda at core.py:2644>)+Start 2/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.475Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.626Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.662Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.666Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.668Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:30.673Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Group/GroupByKey/ReadStream+assert:even/Group/GroupByKey/MergeBuckets+assert:even/Group/Map(_merge_tagged_vals_under_key)+assert:even/Unkey+assert:even/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Create/Impulse+assert:odd/Create/FlatMap(<lambda at core.py:2644>)+assert:odd/Create/Map(decode)+assert:odd/Group/pair_with_0+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start/Map(decode)+Map(split_even_odd)/Map(split_even_odd)+Flatten+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream+assert:even/WindowInto(WindowIntoFn)+assert:odd/WindowInto(WindowIntoFn)+assert:even/ToVoidKey+assert:even/Group/pair_with_1+assert:even/Group/GroupByKey/WriteStream+assert:odd/ToVoidKey+assert:odd/Group/pair_with_1+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Group/GroupByKey/ReadStream+assert:odd/Group/GroupByKey/MergeBuckets+assert:odd/Group/Map(_merge_tagged_vals_under_key)+assert:odd/Unkey+assert:odd/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.274Z: JOB_MESSAGE_BASIC: Finished operation Start/Impulse+Start/FlatMap(<lambda at core.py:2644>)+Start/MaybeReshuffle/Reshuffle/AddRandomKeys+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.275Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Create/Impulse+assert:even/Create/FlatMap(<lambda at core.py:2644>)+assert:even/Create/Map(decode)+assert:even/Group/pair_with_0+assert:even/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.275Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.435Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.465Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.469Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.473Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:36.479Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 2/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 2/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 1/Impulse+Start 1/FlatMap(<lambda at core.py:2644>)+Start 1/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 3/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 3/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start 1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start 1/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start 1/Map(decode)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 2/Impulse+Start 2/FlatMap(<lambda at core.py:2644>)+Start 2/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.946Z: JOB_MESSAGE_BASIC: Finished operation Start 3/Impulse+Start 3/FlatMap(<lambda at core.py:2644>)+Start 3/MaybeReshuffle/Reshuffle/AddRandomKeys+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start 3/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:50.170Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:50.249Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:50.254Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:50.261Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:50.268Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:07.059Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:06.723Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. > Task :sdks:python:test-suites:dataflow:py2:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:44.393Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:49.400Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:47.685Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:52.063Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:52.066Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:52.643Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:51.371Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:51.413Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:52.203Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:57.069Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:55.758Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:55.776Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:56.417Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:59.538Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:57.859Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:58.157Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:09.729Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:09.731Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:10.330Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a. > Task :sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation Start/Impulse+Start/FlatMap(<lambda at core.py:2644>)+Start/MaybeReshuffle/Reshuffle/AddRandomKeys+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Group/GroupByKey/ReadStream+assert:even/Group/GroupByKey/MergeBuckets+assert:even/Group/Map(_merge_tagged_vals_under_key)+assert:even/Unkey+assert:even/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Create/Impulse+assert:odd/Create/FlatMap(<lambda at core.py:2644>)+assert:odd/Create/Map(decode)+assert:odd/Group/pair_with_0+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Start/Map(decode)+Map(split_even_odd)/Map(split_even_odd)+Flatten+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream+assert:even/WindowInto(WindowIntoFn)+assert:odd/WindowInto(WindowIntoFn)+assert:even/ToVoidKey+assert:even/Group/pair_with_1+assert:even/Group/GroupByKey/WriteStream+assert:odd/ToVoidKey+assert:odd/Group/pair_with_1+assert:odd/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation assert:even/Create/Impulse+assert:even/Create/FlatMap(<lambda at core.py:2644>)+assert:even/Create/Map(decode)+assert:even/Group/pair_with_0+assert:even/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.597Z: JOB_MESSAGE_BASIC: Finished operation assert:odd/Group/GroupByKey/ReadStream+assert:odd/Group/GroupByKey/MergeBuckets+assert:odd/Group/Map(_merge_tagged_vals_under_key)+assert:odd/Unkey+assert:odd/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.598Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2644>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.745Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.796Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.805Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.809Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:48.821Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:44:59.919Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:01.249Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:02.255Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:02.137Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:05.793Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:05.772Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:07.583Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:07.961Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:11.029Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:09.844Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:11.123Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:15.012Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:20.807Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:19.056Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. > Task :sdks:python:test-suites:dataflow:py36:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:08.526Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:10.920Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:11.252Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:08.110Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:11.993Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. > Task :sdks:python:test-suites:dataflow:py2:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:15.313Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:14.355Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:23.750Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:31.804Z: JOB_MESSAGE_DETAILED: Workers have started successfully. > Task :sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:42.596Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2020-04-01T18:45:42.638Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-04-01_11_38_27-9712984520049194048 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-04-01_11_38_27-17123971748217433331 is in state JOB_STATE_DONE FATAL: command execution failed java.io.IOException: Backing channel 'JNLP4-connect connection from 250.128.224.35.bc.googleusercontent.com/35.224.128.250:49780' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283) at com.sun.proxy.$Proxy140.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1150) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1142) at hudson.Launcher$ProcStarter.join(Launcher.java:470) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741) at hudson.model.Build$BuildExecution.build(Build.java:206) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504) at hudson.model.Run.execute(Run.java:1815) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused by: java.nio.channels.ClosedChannelException at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154) at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:142) at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:795) at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-6 is offline; cannot locate JDK 1.8 (latest) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
