See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/10/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-10234] Fix error message for missing licenses.
[Robin Qiu] Simple code cleanup for ZetaSqlUtils
[noreply] [BEAM-9951] Adding integration tests for synthetic pipelines in Go
[noreply] [BEAM-9217] Update DoFn javadoc for schema type translation (#11984)
[noreply] Bump default Pubsub timeout to 60 seconds (#11985)
[noreply] Merge pull request #11950 from [BEAM-8596]: Add SplunkIO transform to
[noreply] Support HOP and SESSION as TVF (#11868)
------------------------------------------
[...truncated 14.68 MB...]
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_6"
},
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s20"
},
"serialized_fn": "ref_AppliedPTransform_assert_that/Match_30",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_STREAMING"
}
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2020-06-12_09_56_09-603238140581523150 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
createTime: '2020-06-12T17:06:35.255114Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-06-12_10_06_34-9075660313457198162'
location: 'us-central1'
name: 'beamapp-jenkins-0612170627-224234'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-06-12T17:06:35.255114Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id:
[2020-06-12_10_06_34-9075660313457198162]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job:
2020-06-12_10_06_34-9075660313457198162
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2020-06-12_10_06_34-9075660313457198162?project=apache-beam-testing
WARNING:apache_beam.runners.dataflow.test_dataflow_runner:Waiting indefinitely
for streaming job.
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2020-06-12_10_06_34-9075660313457198162 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:38.228Z:
JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.101Z:
JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable
parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.103Z:
JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into
optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.111Z:
JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.127Z:
JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into
optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.132Z:
JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write
steps
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.142Z:
JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.185Z:
JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.188Z:
JOB_MESSAGE_DETAILED: Unzipping flatten s17 for input s15.None
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.191Z:
JOB_MESSAGE_DETAILED: Fusing unzipped copy of
assert_that/Group/GroupByKey/WriteStream, through flatten
assert_that/Group/Flatten, into producer assert_that/Group/pair_with_0
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.193Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/WriteStream
into assert_that/Group/pair_with_1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.196Z:
JOB_MESSAGE_DETAILED: Fusing consumer Create/FlatMap(<lambda at core.py:2623>)
into Create/Impulse
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.198Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/FlatMap(<lambda at
core.py:2623>) into assert_that/Create/Impulse
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.202Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/Map(decode) into
assert_that/Create/FlatMap(<lambda at core.py:2623>)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.205Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_0 into
assert_that/Create/Map(decode)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.207Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/AddRandomKeys into Create/FlatMap(<lambda at
core.py:2623>)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.210Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into
Create/MaybeReshuffle/Reshuffle/AddRandomKeys
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.213Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream into
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.216Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets into
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.218Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.221Z:
JOB_MESSAGE_DETAILED: Fusing consumer
Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys into
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.223Z:
JOB_MESSAGE_DETAILED: Fusing consumer Create/Map(decode) into
Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.225Z:
JOB_MESSAGE_DETAILED: Fusing consumer Ele param into Create/Map(decode)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.228Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into
Ele param
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.230Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into
assert_that/WindowInto(WindowIntoFn)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.232Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_1 into
assert_that/ToVoidKey
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.234Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/MergeBuckets
into assert_that/Group/GroupByKey/ReadStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.237Z:
JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/Map(_merge_tagged_vals_under_key) into
assert_that/Group/GroupByKey/MergeBuckets
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.238Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into
assert_that/Group/Map(_merge_tagged_vals_under_key)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.241Z:
JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.254Z:
JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.271Z:
JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.305Z:
JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.461Z:
JOB_MESSAGE_DEBUG: Executing wait step start2
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.474Z:
JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:39.480Z:
JOB_MESSAGE_BASIC: Starting 1 workers...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:44.201Z:
JOB_MESSAGE_BASIC: Executing operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Ele
param+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:44.201Z:
JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at
core.py:2623>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:44.201Z:
JOB_MESSAGE_BASIC: Executing operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:44.216Z:
JOB_MESSAGE_BASIC: Executing operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:06:59.805Z:
JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric
descriptors and Stackdriver will not create new Dataflow custom metrics for
this job. Each unique user-defined metric name (independent of the DoFn in
which it is defined) produces a new metric descriptor. To delete old / unused
metric descriptors see
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:20.159Z:
JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:20.747Z:
JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:38.790Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
> Task :sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.938Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.938Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.938Z:
JOB_MESSAGE_BASIC: Finished operation
compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.938Z:
JOB_MESSAGE_BASIC: Finished operation start/Impulse+start/FlatMap(<lambda at
core.py:2623>)+start/MaybeReshuffle/Reshuffle/AddRandomKeys+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.938Z:
JOB_MESSAGE_BASIC: Finished operation side/Impulse+side/FlatMap(<lambda at
core.py:2623>)+side/Map(decode)+compute/MapToVoidKey0+compute/MapToVoidKey0+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:54.939Z:
JOB_MESSAGE_BASIC: Finished operation
start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+start/Map(decode)+compute/compute+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.099Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.143Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.150Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.156Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.167Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.820Z:
JOB_MESSAGE_BASIC: Finished operation FlatMap(<lambda at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+FlatMap(<lambda
at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+FlatMap(<lambda
at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+FlatMap(<lambda
at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.820Z:
JOB_MESSAGE_BASIC: Finished operation
start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+start/Map(decode)+FlatMap(<lambda
at sideinputs_test.py:184>)/FlatMap(<lambda at
sideinputs_test.py:184>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.820Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.821Z:
JOB_MESSAGE_BASIC: Finished operation start/Impulse+start/FlatMap(<lambda at
core.py:2623>)+start/MaybeReshuffle/Reshuffle/AddRandomKeys+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.821Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.821Z:
JOB_MESSAGE_BASIC: Finished operation side/Impulse+side/FlatMap(<lambda at
core.py:2623>)+side/Map(decode)+FlatMap(<lambda at
sideinputs_test.py:184>)/MapToVoidKey0+FlatMap(<lambda at
sideinputs_test.py:184>)/MapToVoidKey0+FlatMap(<lambda at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FlatMap(<lambda
at
sideinputs_test.py:184>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.965Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.993Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.997Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:55.999Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:07:56.003Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/ReadStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/MergeBuckets+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/Values+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation main input/Impulse+main
input/FlatMap(<lambda at core.py:2623>)+main input/Map(decode)+Map(<lambda at
sideinputs_test.py:235>)/Map(<lambda at
sideinputs_test.py:235>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.271Z:
JOB_MESSAGE_BASIC: Finished operation side list/Impulse+side
list/FlatMap(<lambda at core.py:2623>)+side list/Map(decode)+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey0+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey1+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey0+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey1+Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/PairWithVoidKey+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/WriteStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.435Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.458Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.462Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.464Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:03.468Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation side2/Impulse+side2/FlatMap(<lambda at
core.py:2623>)+side2/Map(decode)+FlatMap(<lambda at
sideinputs_test.py:338>)/MapToVoidKey0+FlatMap(<lambda at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FlatMap(<lambda
at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream+FlatMap(<lambda
at sideinputs_test.py:338>)/MapToVoidKey0
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation side1/Impulse+side1/FlatMap(<lambda at
core.py:2623>)+side1/Map(decode)+FlatMap(<lambda at
sideinputs_test.py:338>)/MapToVoidKey0+FlatMap(<lambda at
sideinputs_test.py:338>)/MapToVoidKey0+FlatMap(<lambda at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FlatMap(<lambda
at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation main input/Impulse+main
input/FlatMap(<lambda at core.py:2623>)+main input/Map(decode)+FlatMap(<lambda
at sideinputs_test.py:338>)/FlatMap(<lambda at
sideinputs_test.py:338>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation FlatMap(<lambda at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+FlatMap(<lambda
at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+FlatMap(<lambda
at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+FlatMap(<lambda
at
sideinputs_test.py:338>)/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.295Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.450Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.471Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.474Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.476Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:27.481Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.847Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation side/Impulse+side/FlatMap(<lambda at
core.py:2623>)+side/MaybeReshuffle/Reshuffle/AddRandomKeys+side/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+side/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation
start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+start/MaybeReshuffle/Reshuffle/RemoveRandomKeys+start/Map(decode)+compute/compute+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation
side/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+side/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+side/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+side/MaybeReshuffle/Reshuffle/RemoveRandomKeys+side/Map(decode)+compute/MapToVoidKey0+compute/MapToVoidKey0+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation
compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+compute/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation start/Impulse+start/FlatMap(<lambda at
core.py:2623>)+start/MaybeReshuffle/Reshuffle/AddRandomKeys+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+start/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.848Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:29.993Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:30.028Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:30.033Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:30.037Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:30.044Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
> Task :sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.503Z:
JOB_MESSAGE_BASIC: Finished operation Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/ReadStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/MergeBuckets+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/Values+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.503Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.504Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.504Z:
JOB_MESSAGE_BASIC: Finished operation main input/Impulse+main
input/FlatMap(<lambda at core.py:2623>)+main input/Map(decode)+Map(<lambda at
sideinputs_test.py:235>)/Map(<lambda at
sideinputs_test.py:235>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.504Z:
JOB_MESSAGE_BASIC: Finished operation Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.504Z:
JOB_MESSAGE_BASIC: Finished operation side list/Impulse+side
list/FlatMap(<lambda at core.py:2623>)+side list/Map(decode)+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey0+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey1+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey0+Map(<lambda at
sideinputs_test.py:235>)/MapToVoidKey1+Map(<lambda at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/PairWithVoidKey+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey1.out.0)/GroupByKey/WriteStream+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+Map(<lambda
at
sideinputs_test.py:235>)/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.673Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.714Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.717Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.720Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:38.727Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
> Task :sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation
formatted_before_reshuffle/Create/Impulse+formatted_before_reshuffle/Create/FlatMap(<lambda
at
core.py:2623>)+formatted_before_reshuffle/Create/Map(decode)+formatted_before_reshuffle/Group/pair_with_0+formatted_before_reshuffle/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at
core.py:2623>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation
formatted_before_reshuffle/Group/GroupByKey/ReadStream+formatted_before_reshuffle/Group/GroupByKey/MergeBuckets+formatted_before_reshuffle/Group/Map(_merge_tagged_vals_under_key)+formatted_before_reshuffle/Unkey+formatted_before_reshuffle/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation
formatted_after_reshuffle/Create/Impulse+formatted_after_reshuffle/Create/FlatMap(<lambda
at
core.py:2623>)+formatted_after_reshuffle/Create/Map(decode)+formatted_after_reshuffle/Group/pair_with_0+formatted_after_reshuffle/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation
formatted_after_reshuffle/Group/GroupByKey/ReadStream+formatted_after_reshuffle/Group/GroupByKey/MergeBuckets+formatted_after_reshuffle/Group/Map(_merge_tagged_vals_under_key)+formatted_after_reshuffle/Unkey+formatted_after_reshuffle/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.582Z:
JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Map(<lambda
at util_test.py:562>)+Reshuffle/AddRandomKeys+Get before_reshuffle
timestamp+Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Reshuffle/ReshufflePerKey/GroupByKey/WriteStream+formatted_before_reshuffle/WindowInto(WindowIntoFn)+formatted_before_reshuffle/ToVoidKey+formatted_before_reshuffle/Group/pair_with_1+formatted_before_reshuffle/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.588Z:
JOB_MESSAGE_BASIC: Finished operation
Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Reshuffle/RemoveRandomKeys+Get
after_reshuffle
timestamp+formatted_after_reshuffle/WindowInto(WindowIntoFn)+formatted_after_reshuffle/ToVoidKey+formatted_after_reshuffle/Group/pair_with_1+formatted_after_reshuffle/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.746Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.800Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.808Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.812Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:40.821Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.047Z:
JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/ReadStream+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/MergeBuckets+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Ele
param+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.047Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.047Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2623>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.047Z:
JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at
core.py:2623>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/WriteStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.191Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.225Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.231Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.235Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-06-12T17:08:47.247Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
FATAL: command execution failed
java.io.IOException: Backing channel 'temporal-beam-jenkins-1' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
at com.sun.proxy.$Proxy163.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1150)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1142)
at hudson.Launcher$ProcStarter.join(Launcher.java:470)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
at hudson.model.Build$BuildExecution.build(Build.java:206)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
at hudson.model.Run.execute(Run.java:1853)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:427)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:91)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:73)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:103)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: temporal-beam-jenkins-1 is offline; cannot locate JDK 1.8 (latest)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
