See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/711/display/redirect>
Changes: ------------------------------------------ [...truncated 2.63 MB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:22.697Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:22.720Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.422Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:2930>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.585Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.680Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.831Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_30/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:22.896Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Map(<lambda at sql_test.py:149>)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:22.992Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.048Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:23.128Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.590Z: JOB_MESSAGE_BASIC: Finished operation Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create enrich/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create enrich/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs/ParMultiDo(Anonymous)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.593Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.654Z: JOB_MESSAGE_DEBUG: Executing success step success24 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.723Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.771Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:27.798Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:29.075Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:29.131Z: JOB_MESSAGE_DEBUG: Executing success step success33 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:29.195Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:29.238Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:29.265Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.010Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_30/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.061Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.093Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.135Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:28.716Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2930>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.733Z: JOB_MESSAGE_BASIC: Finished operation Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create simple/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create simple/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs/ParMultiDo(Anonymous)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.771Z: JOB_MESSAGE_BASIC: Executing operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.814Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:30.870Z: JOB_MESSAGE_BASIC: Executing operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)/ParMultiDo(ConvertCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Select.Fields/ParDo(Select)/ParMultiDo(Select)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_96/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:32.161Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:32.234Z: JOB_MESSAGE_DEBUG: Executing success step success27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:32.326Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:32.375Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:32.413Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:34.590Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse+SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+external_2SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun/PairWithRestriction+external_2SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun/SplitWithSizing INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:34.685Z: JOB_MESSAGE_DEBUG: Value "external_2SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun-split-with-sizing-out3" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:34.749Z: JOB_MESSAGE_BASIC: Executing operation external_2SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun/ProcessElementAndRestrictionWithSizing+SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.239Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.269Z: JOB_MESSAGE_DEBUG: Executing success step success27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.335Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.376Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.419Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:39.340Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2930>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:41.705Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)/ParMultiDo(ConvertCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Select.Fields/ParDo(Select)/ParMultiDo(Select)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_96/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:41.759Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:41.801Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:41.859Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:42.597Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_30/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:42.646Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:42.686Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:42.733Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.874Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.918Z: JOB_MESSAGE_DEBUG: Executing success step success27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.998Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:52.042Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:52.095Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.321Z: JOB_MESSAGE_BASIC: Finished operation external_2SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun/ProcessElementAndRestrictionWithSizing+SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.391Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.437Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.511Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:50.965Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.019Z: JOB_MESSAGE_DEBUG: Executing success step success55 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.091Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.132Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:55:51.176Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:00.092Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:00.160Z: JOB_MESSAGE_DEBUG: Executing success step success24 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:00.245Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:00.357Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:00.383Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:08.362Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:08.395Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:08.419Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_12-7686361212731639228 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:12.620Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:12.668Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:12.704Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:15.565Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:15.598Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:15.628Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:19.853Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:19.975Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:20.004Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_12-6993124916648096519 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_14-3491795782814318765 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_12-920007805013327341 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:32.485Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:32.523Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:32.544Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:34.811Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:34.845Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:34.867Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:41.968Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:42.006Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:42.050Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:43.680Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:43.724Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-05-11T12:56:43.762Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_16-12541028334586866558 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_13-4172326703423403008 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_13-9533943409828013200 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-05-11_05_48_20-2755824934343004653 is in state JOB_STATE_DONE test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... ERROR test_project (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_agg (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_row (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_tagged_join (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_map (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_filter (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... ok ====================================================================== ERROR: test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,> line 175, in test_windowing_before_sql | SqlTransform("SELECT COUNT(*) as `count` FROM PCOLLECTION")) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,> line 142, in __or__ return self.pipeline.apply(ptransform, self) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,> line 691, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 141, in apply return super(DataflowRunner, self).apply(transform, input, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 188, in apply return m(transform, input, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 218, in apply_PTransform return transform.expand(input) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 304, in expand pipeline.local_tempdir) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 357, in _resolve_artifacts artifact_service.resolve_artifacts(env.dependencies, service, dest)) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py";,> line 282, in resolve_artifacts artifacts=artifacts)).replacements File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py";,> line 280, in <listcomp> dest_dir) for artifact in service.ResolveArtifacts( File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py";,> line 298, in maybe_store_artifact return store_artifact(artifact, service, dest_dir) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py";,> line 307, in store_artifact beam_artifact_api_pb2.GetArtifactRequest(artifact=artifact)): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "Connection reset by peer" debug_error_string = "{"created":"@1620737283.362659041","description":"Error received from peer ipv4:127.0.0.1:54865","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Connection reset by peer","grpc_status":14}" > -------------------- >> begin captured logging << -------------------- apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar> apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '54865'] root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. apache_beam.utils.subprocess_server: INFO: b'Starting expansion service at localhost:54865' root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. apache_beam.utils.subprocess_server: INFO: b'May 11, 2021 12:47:53 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' apache_beam.utils.subprocess_server: INFO: b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a' root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. apache_beam.utils.subprocess_server: INFO: b'Exception in thread "main" java.io.IOException: Failed to bind' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.netty.NettyServer.start(NettyServer.java:257)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:184)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:90)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.sdk.expansion.service.ExpansionService.main(ExpansionService.java:521)' apache_beam.utils.subprocess_server: INFO: b'Caused by: java.net.BindException: Address already in use' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind0(Native Method)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind(Net.java:461)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind(Net.java:453)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:132)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:551)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1346)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:503)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:488)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:985)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:247)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:344)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:510)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:518)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)' apache_beam.utils.subprocess_server: INFO: b'\tat java.lang.Thread.run(Thread.java:748)' root: DEBUG: Waiting for grpc channel to be ready at localhost:54865. --------------------- >> end captured logging << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_12-6993124916648096519?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_13-4172326703423403008?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_12-920007805013327341?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_13-9533943409828013200?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_12-7686361212731639228?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_14-3491795782814318765?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_16-12541028334586866558?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-11_05_48_20-2755824934343004653?project=apache-beam-testing ---------------------------------------------------------------------- XML: nosetests-xlangSqlValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 9 tests in 544.838s FAILED (errors=1) > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 32093. Stopping expansion service pid: 32096. > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511124055 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe05d6aaa535ad102a799d036724f150ec4d786177ccf60bc51e9a7ac591e01 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe05d6aaa535ad102a799d036724f150ec4d786177ccf60bc51e9a7ac591e01 Associated tags: - 20210511124055 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511124055 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511124055]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe05d6aaa535ad102a799d036724f150ec4d786177ccf60bc51e9a7ac591e01]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 16m 2s 140 actionable tasks: 49 executed, 12 from cache, 79 up-to-date Publishing build scan... https://gradle.com/s/mcqp3iwwkgjha Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
