See <https://builds.apache.org/job/beam_PostCommit_Python37/2058/display/redirect?page=changes>
Changes: [alex] [BEAM-9044] Protobuf options to Schema options ------------------------------------------ [...truncated 10.52 MB...] apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:13.845Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:13.880Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:13.918Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey into write/Write/WriteImpl/PreFinalize/MapToVoidKey1 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:13.951Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write into write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:13.978Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap into write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.015Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey into write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.044Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.082Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.117Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey into write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.150Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.180Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.203Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/CreateIsmShardKeyAndSortKey into write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.238Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/CreateIsmShardKeyAndSortKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.300Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/ToIsmRecordForMultimap into write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.421Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.481Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.512Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.546Z: JOB_MESSAGE_DEBUG: Assigning stage ids. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:14.961Z: JOB_MESSAGE_DEBUG: Executing wait step start120 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.029Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.063Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.074Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.089Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.112Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a... apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.125Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.146Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.148Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.162Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.162Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.183Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.186Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.203Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.212Z: JOB_MESSAGE_BASIC: Executing operation group/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.243Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.243Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.266Z: JOB_MESSAGE_BASIC: Finished operation group/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.280Z: JOB_MESSAGE_BASIC: Executing operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.352Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.360Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.407Z: JOB_MESSAGE_BASIC: Finished operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.433Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.480Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.510Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.547Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.588Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.631Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.660Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.697Z: JOB_MESSAGE_DEBUG: Value "read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.736Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Impulse+write/Write/WriteImpl/DoOnce/FlatMap(<lambda at core.py:2644>)+write/Write/WriteImpl/DoOnce/Map(decode)+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:15.776Z: JOB_MESSAGE_BASIC: Executing operation read/Read/Impulse+read/Read/Split+read/Read/Reshuffle/AddRandomKeys+read/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:29.162Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:52:38.921Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:53:16.463Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:53:16.492Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.812Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/DoOnce/Impulse+write/Write/WriteImpl/DoOnce/FlatMap(<lambda at core.py:2644>)+write/Write/WriteImpl/DoOnce/Map(decode)+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.880Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Map(decode).out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.921Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.939Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.950Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.970Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:14.982Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:15.002Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:15.039Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:15.048Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:15.072Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:15.109Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:16.056Z: JOB_MESSAGE_BASIC: Finished operation read/Read/Impulse+read/Read/Split+read/Read/Reshuffle/AddRandomKeys+read/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:16.126Z: JOB_MESSAGE_BASIC: Executing operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:16.196Z: JOB_MESSAGE_BASIC: Finished operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:16.263Z: JOB_MESSAGE_BASIC: Executing operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Read+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read/Read/Reshuffle/RemoveRandomKeys+read/Read/ReadSplits+split+pair_with_one+group/Reify+group/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:33.996Z: JOB_MESSAGE_BASIC: Finished operation read/Read/Reshuffle/ReshufflePerKey/GroupByKey/Read+read/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read/Read/Reshuffle/RemoveRandomKeys+read/Read/ReadSplits+split+pair_with_one+group/Reify+group/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:34.065Z: JOB_MESSAGE_BASIC: Executing operation group/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:34.127Z: JOB_MESSAGE_BASIC: Finished operation group/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:52.014Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:52.096Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:52.165Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:52.217Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:52.296Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey0.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:55.278Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:55.346Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:55.420Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:55.474Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:55.551Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey0.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:57.821Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:57.885Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:57.959Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:58.005Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:58.081Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(MapToVoidKey0.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:58:58.144Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:05.251Z: JOB_MESSAGE_BASIC: Finished operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:05.328Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:05.388Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:05.449Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Read+write/Write/WriteImpl/GroupByKey/GroupByWindow+write/Write/WriteImpl/Extract+write/Write/WriteImpl/PreFinalize/MapToVoidKey1+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1+write/Write/WriteImpl/PreFinalize/MapToVoidKey1+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.069Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Read+write/Write/WriteImpl/GroupByKey/GroupByWindow+write/Write/WriteImpl/Extract+write/Write/WriteImpl/PreFinalize/MapToVoidKey1+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1+write/Write/WriteImpl/PreFinalize/MapToVoidKey1+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.158Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.200Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.206Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.247Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.281Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:09.324Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:17.165Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:17.241Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:17.305Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:17.359Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:17.440Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey1.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.446Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.524Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.587Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.640Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.721Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(MapToVoidKey1.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:18.800Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/PreFinalize+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:19.957Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/PreFinalize+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/CreateIsmShardKeyAndSortKey+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:20.034Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:20.092Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:20.165Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.597Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/GroupByKeyHashAndSortByKeyAndWindow/Read+write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/ToIsmRecordForMultimap apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.671Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/ToIsmRecordForMultimap.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.750Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.795Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/View apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.866Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(MapToVoidKey2.out.0)/View.out0" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:22.944Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/FinalizeWrite apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:25.075Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/FinalizeWrite apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:25.156Z: JOB_MESSAGE_DEBUG: Executing success step success118 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:25.268Z: JOB_MESSAGE_DETAILED: Cleaning up. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:25.326Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T11:59:25.364Z: JOB_MESSAGE_BASIC: Stopping worker pool... apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T12:01:10.610Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T12:01:10.668Z: JOB_MESSAGE_BASIC: Worker pool stopped. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-04-03T12:01:10.707Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-04-03_04_52_05-10204193762984948593 is in state JOB_STATE_DONE apache_beam.testing.pipeline_verifiers: INFO: Wait 20 seconds... apache_beam.io.filesystem: DEBUG: Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results' apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results*-of-*' -> 'gs://temp\\-storage\\-for\\-end\\-to\\-end\\-tests/py\\-it\\-cloud/output/1585914709406/results[^/\\\\]*\\-of\\-[^/\\\\]*' apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input apache_beam.io.gcp.gcsio: INFO: Finished listing 3 files in 0.03606104850769043 seconds. apache_beam.testing.pipeline_verifiers: INFO: Find 3 files in gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results*-of-*: gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results-00000-of-00003 gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results-00001-of-00003 gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results-00002-of-00003 apache_beam.testing.pipeline_verifiers: INFO: Read from given path gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results*-of-*, 4784 lines, checksum: 33535a832b7db6d78389759577d4ff495980b9c0. root: INFO: number of empty lines: 0 apache_beam.io.filesystem: DEBUG: Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results' apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1585914709406/results*' -> 'gs://temp\\-storage\\-for\\-end\\-to\\-end\\-tests/py\\-it\\-cloud/output/1585914709406/results[^/\\\\]*' apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input apache_beam.io.gcp.gcsio: INFO: Finished listing 3 files in 0.03426790237426758 seconds. --------------------- >> end captured logging << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_35-4763419982986696168?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_57_45-9620303494757305969?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_07_52-15199889811875091087?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_16_25-12346731359183715422?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_25_17-11008434845686533841?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_34_03-6179746475256875783?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_31-8362048910788379173?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_05_16-18309989068891927916?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_13_59-10222080361104380231?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_23_17-4240456582844568308?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_31_50-897154752267506409?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_30-2290890548099855869?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_04_49-10378555713605842577?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_13_50-16548533293211127003?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_21_33-13002330964452842167?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_31_06-1136650260851824637?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_35-15026946192094274607?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_55_38-13256750230383970248?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_05_12-11565306609985645563?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_13_21-421400718817051343?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_21_00-15901957483832137416?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_28_55-7431459988118746314?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_32-11224921494947579951?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_52_40-8759560127541376387?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_00_52-2585614151718875768?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_09_59-12889137991054110926?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_18_36-13256048303263659245?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_26_51-789292768550019772?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_35_30-7846576780480084801?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_31-614551714945998196?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_52_05-10204193762984948593?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_01_59-919125737007834518?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_10_12-13678573519085994350?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_19_44-1578581862785059629?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_28_26-391759111016409478?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_36_34-3559619153205160161?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_32-11860070035164749462?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_53_54-4928110682658793756?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_05_48-2742710704395309291?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_15_06-18292858161776819686?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_32_10-15754164579235192644?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_43_34-7350471777477416845?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_04_52_30-15902862930137598516?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_02_10-10562475476826242132?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_10_16-10317043523378197577?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_19_45-2600952574480491532?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_26_53-4159739476904938757?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_34_18-11031790063011623030?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-03_05_42_56-10478756837332471002?project=apache-beam-testing ---------------------------------------------------------------------- XML: nosetests-postCommitIT-df-py37.xml ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 59 tests in 4134.351s FAILED (SKIP=9, errors=1) > Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/direct/py37/build.gradle'> line: 60 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:py37:hdfsIntegrationTest'. > Process 'command 'sh'' finished with non-zero exit value 255 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/py37/build.gradle'> line: 89 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 10m 32s 87 actionable tasks: 68 executed, 19 from cache Publishing build scan... https://gradle.com/s/mm6imarm3yuna Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
