See
<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/41/display/redirect?page=changes>
Changes:
[thw] Optional Flink job server parameters and logging cleanup.
------------------------------------------
[...truncated 6.26 MB...]
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel
established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness
with 12 workers.
[grpc-default-executor-2] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.run - Got work 1
[grpc-default-executor-0] INFO sdk_worker.run - Got work 6
[grpc-default-executor-0] INFO sdk_worker.run - Got work 5
[grpc-default-executor-0] INFO sdk_worker.run - Got work 3
[grpc-default-executor-0] INFO sdk_worker.run - Got work 2
[grpc-default-executor-0] INFO sdk_worker.run - Got work 4
[grpc-default-executor-2] INFO sdk_worker.run - Got work 8
[grpc-default-executor-2] INFO sdk_worker.run - Got work 7
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating
channel for localhost:45469
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating
channel for localhost:37021
[grpc-default-executor-2] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation
assert_that/Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/Reshuffle/AddRandomKeys output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Create/Read/Reshuffle/AddRandomKeys
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/Split output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[BytesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[BytesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/Split output_tags=['out'],
receivers=[ConsumerSet[Create/Read/Split.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Create/Read/Split output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/Reshuffle/AddRandomKeys output_tags=['out'],
receivers=[ConsumerSet[Create/Read/Reshuffle/AddRandomKeys.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
output_tags=['out'],
receivers=[ConsumerSet[Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[BytesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[BytesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Create/Read/Split output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/Split.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Create/Read/Reshuffle/AddRandomKeys
output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/Reshuffle/AddRandomKeys.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation
assert_that/Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[Source: Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Source: Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (812c2f2d54c0849fac97c7910923cd5c) switched from
RUNNING to FINISHED.
[Source: Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for Source: Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (812c2f2d54c0849fac97c7910923cd5c).
[Source: Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task Source: Collection Source
->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (812c2f2d54c0849fac97c7910923cd5c) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source:
Collection Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem 812c2f2d54c0849fac97c7910923cd5c.
[Source: Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Source: Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (3ba53b8338e6e0209785a377f1047391) switched from
RUNNING to FINISHED.
[Source: Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for Source: Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (3ba53b8338e6e0209785a377f1047391).
[Source: Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task Source: Collection Source
->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (3ba53b8338e6e0209785a377f1047391) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Collection
Source ->
31assert_that/Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (812c2f2d54c0849fac97c7910923cd5c) switched from
RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source:
Collection Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem 3ba53b8338e6e0209785a377f1047391.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Collection
Source ->
19Create/Read/Impulse.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (3ba53b8338e6e0209785a377f1047391) switched from
RUNNING to FINISHED.
[grpc-default-executor-2] INFO sdk_worker.run - Got work 9
[grpc-default-executor-2] INFO sdk_worker.run - Got work 10
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<FlattenOperation assert_that/Group/Flatten >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Group/pair_with_0 output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Create/Read/ReadSplits output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Create/Read/Reshuffle/RemoveRandomKeys
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation
assert_that/Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
LengthPrefixCoder[FastPrimitivesCoder]]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
LengthPrefixCoder[FastPrimitivesCoder]]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation
assert_that/Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps).out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Create/Read/Reshuffle/RemoveRandomKeys
output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/Reshuffle/RemoveRandomKeys.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Create/Read/ReadSplits output_tags=['out'],
receivers=[ConsumerSet[assert_that/Create/Read/ReadSplits.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Group/pair_with_0 output_tags=['out'],
receivers=[ConsumerSet[assert_that/Group/pair_with_0.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<FlattenOperation assert_that/Group/Flatten
receivers=[ConsumerSet[assert_that/Group/Flatten.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation WindowInto(WindowIntoFn) output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Map(<lambda at fn_api_runner_test.py:269>) output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/ReadSplits output_tags=['out']>
[assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (a3494f40599c9ea6b466958a63c0a267) switched from RUNNING to FINISHED.
[assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (a3494f40599c9ea6b466958a63c0a267).
[assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (a3494f40599c9ea6b466958a63c0a267) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
a3494f40599c9ea6b466958a63c0a267.
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/Reshuffle/RemoveRandomKeys output_tags=['out']>
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
74assert_that/Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (a3494f40599c9ea6b466958a63c0a267) switched from RUNNING to FINISHED.
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
LengthPrefixCoder[FastPrimitivesCoder]]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
LengthPrefixCoder[FastPrimitivesCoder]]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
output_tags=['out'],
receivers=[ConsumerSet[Create/Read/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps).out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/Reshuffle/RemoveRandomKeys output_tags=['out'],
receivers=[ConsumerSet[Create/Read/Reshuffle/RemoveRandomKeys.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation Create/Read/ReadSplits output_tags=['out'],
receivers=[ConsumerSet[Create/Read/ReadSplits.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation Map(<lambda at fn_api_runner_test.py:269>) output_tags=['out'],
receivers=[ConsumerSet[Map(<lambda at fn_api_runner_test.py:269>).out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation WindowInto(WindowIntoFn) output_tags=['out'],
receivers=[ConsumerSet[WindowInto(WindowIntoFn).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (f76b5e901fa3063106d2846bc141e4a6) switched from
RUNNING to FINISHED.
[Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (f76b5e901fa3063106d2846bc141e4a6).
[Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (f76b5e901fa3063106d2846bc141e4a6) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem f76b5e901fa3063106d2846bc141e4a6.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
Create/Read/Reshuffle/ReshufflePerKey/GroupByKey ->
62Create/Read/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
-> ToKeyedWorkItem (1/1) (f76b5e901fa3063106d2846bc141e4a6) switched from
RUNNING to FINISHED.
[grpc-default-executor-0] INFO sdk_worker.run - Got work 11
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<FlattenOperation assert_that/Group/Flatten >
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Group/pair_with_1 output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/ToVoidKey output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/WindowInto(WindowIntoFn) output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation Map(<lambda at fn_api_runner_test.py:272>) output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation Map(<lambda at fn_api_runner_test.py:272>) output_tags=['out'],
receivers=[ConsumerSet[Map(<lambda at fn_api_runner_test.py:272>).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/WindowInto(WindowIntoFn) output_tags=['out'],
receivers=[ConsumerSet[assert_that/WindowInto(WindowIntoFn).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/ToVoidKey output_tags=['out'],
receivers=[ConsumerSet[assert_that/ToVoidKey.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Group/pair_with_1 output_tags=['out'],
receivers=[ConsumerSet[assert_that/Group/pair_with_1.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, TupleCoder[FastPrimitivesCoder,
FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<FlattenOperation assert_that/Group/Flatten
receivers=[ConsumerSet[assert_that/Group/Flatten.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[grpc-default-executor-0] INFO sdk_worker.run - Got work 12
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DataOutputOperation >
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<FlattenOperation assert_that/Group/Flatten >
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Group/pair_with_1 output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/ToVoidKey output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/WindowInto(WindowIntoFn) output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DoOperation Map(<lambda at fn_api_runner_test.py:272>) output_tags=['out']>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation Map(<lambda at fn_api_runner_test.py:272>) output_tags=['out'],
receivers=[ConsumerSet[Map(<lambda at fn_api_runner_test.py:272>).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/WindowInto(WindowIntoFn) output_tags=['out'],
receivers=[ConsumerSet[assert_that/WindowInto(WindowIntoFn).out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/ToVoidKey output_tags=['out'],
receivers=[ConsumerSet[assert_that/ToVoidKey.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]]], len(consumers)=1]]>
[grpc-default-executor-0] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Group/pair_with_1 output_tags=['out'],
receivers=[ConsumerSet[assert_that/Group/pair_with_1.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder,
TupleCoder[FastPrimitivesCoder, TupleCoder[FastPrimitivesCoder,
FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<FlattenOperation assert_that/Group/Flatten
receivers=[ConsumerSet[assert_that/Group/Flatten.out0,
coder=WindowedValueCoder[TupleCoder[FastPrimitivesCoder, FastPrimitivesCoder]],
len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataOutputOperation >
[GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (d161b6eef96ec5f25785c49cc9fdbc0a) switched from RUNNING to FINISHED.
[GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (d161b6eef96ec5f25785c49cc9fdbc0a).
[GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (d161b6eef96ec5f25785c49cc9fdbc0a) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
d161b6eef96ec5f25785c49cc9fdbc0a.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (1be76aace68df531a9792df03f39f760) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (1/1)
(1be76aace68df531a9792df03f39f760).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1)
(1be76aace68df531a9792df03f39f760) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
1be76aace68df531a9792df03f39f760.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (d161b6eef96ec5f25785c49cc9fdbc0a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(1be76aace68df531a9792df03f39f760) switched from RUNNING to FINISHED.
[grpc-default-executor-2] INFO sdk_worker.run - Got work 13
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Match output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Unkey output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DoOperation assert_that/Group/Map(_merge_tagged_vals_under_key)
output_tags=['out']>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - start
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DataInputOperation receivers=[ConsumerSet[.out0,
coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder],
IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Group/Map(_merge_tagged_vals_under_key)
output_tags=['out'],
receivers=[ConsumerSet[assert_that/Group/Map(_merge_tagged_vals_under_key).out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Unkey output_tags=['out'],
receivers=[ConsumerSet[assert_that/Unkey.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
[grpc-default-executor-2] INFO bundle_processor.process_bundle - finish
<DoOperation assert_that/Match output_tags=['out'],
receivers=[ConsumerSet[assert_that/Match.out0,
coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=0]]>
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-2] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-2] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up
for unknown endpoint.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] WARN org.apache.beam.runners.fnexecution.control.JobBundleFactoryBase -
Error cleaning up environment url:
"jenkins-docker-apache.bintray.io/beam/python:latest"
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.guava.v20.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at
org.apache.beam.vendor.grpc.v1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at
org.apache.beam.vendor.grpc.v1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:54)
at
org.apache.beam.runners.fnexecution.GrpcFnServer.close(GrpcFnServer.java:83)
at
org.apache.beam.runners.fnexecution.control.JobBundleFactoryBase$WrappedSdkHarnessClient.$closeResource(JobBundleFactoryBase.java:327)
at
org.apache.beam.runners.fnexecution.control.JobBundleFactoryBase$WrappedSdkHarnessClient.close(JobBundleFactoryBase.java:327)
at
org.apache.beam.runners.fnexecution.control.JobBundleFactoryBase.lambda$createEnvironmentCache$0(JobBundleFactoryBase.java:147)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1963)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3562)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3538)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3309)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache.clear(LocalCache.java:4322)
at
org.apache.beam.repackaged.beam_runners_java_fn_execution.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4937)
at
org.apache.beam.runners.fnexecution.control.JobBundleFactoryBase.close(JobBundleFactoryBase.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.close(FlinkDefaultExecutableStageContext.java:46)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingFlinkExecutableStageContextFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingFlinkExecutableStageContextFactory.java:161)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.release(ReferenceCountingFlinkExecutableStageContextFactory.java:149)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.scheduleRelease(ReferenceCountingFlinkExecutableStageContextFactory.java:109)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.access$300(ReferenceCountingFlinkExecutableStageContextFactory.java:40)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.close(ReferenceCountingFlinkExecutableStageContextFactory.java:181)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.$closeResource(ExecutableStageDoFnOperator.java:187)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.close(ExecutableStageDoFnOperator.java:202)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:438)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:323)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (e94f912bfb239c81b085c6bda58e2d08) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (e94f912bfb239c81b085c6bda58e2d08).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (e94f912bfb239c81b085c6bda58e2d08) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
e94f912bfb239c81b085c6bda58e2d08.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/jenkins-docker-apache.bintray.io/beam/python:latest:0
(1/1) (e94f912bfb239c81b085c6bda58e2d08) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1537210263.11 (b5edf5b96a8f69b601c720d21b864dc0) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job b5edf5b96a8f69b601c720d21b864dc0.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
b5edf5b96a8f69b601c720d21b864dc0 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1537210263.11(b5edf5b96a8f69b601c720d21b864dc0).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
fb5cc3d41761971130113260381f405f: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 80b2a82964bbaabab2b6d802153f463c@akka://flink/user/jobmanager_37
for job b5edf5b96a8f69b601c720d21b864dc0 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint
org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet.
Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation
until processing is started.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job b5edf5b96a8f69b601c720d21b864dc0.
[flink-runner-job-server] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher122c2fbb-6135-41ec-934f-05f7cabf7d3b.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher122c2fbb-6135-41ec-934f-05f7cabf7d3b.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Unregister
TaskManager d36b0e561f951fea48032294204c07e8 from the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
b5edf5b96a8f69b601c720d21b864dc0 with leader id
80b2a82964bbaabab2b6d802153f463c lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{408af56b4dbc33379708b0a20f95645e}, jobId:
b5edf5b96a8f69b601c720d21b864dc0).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
b5edf5b96a8f69b601c720d21b864dc0 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job b5edf5b96a8f69b601c720d21b864dc0.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_36.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[ForkJoinPool.commonPool-worker-4] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher122c2fbb-6135-41ec-934f-05f7cabf7d3b.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-b17bf87d-c8e4-4d9d-8c33-ea018813e291
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_36.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:46111
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 1715 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@da2ae7de
.
----------------------------------------------------------------------
Ran 22 tests in 58.961s
OK (skipped=5)
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 4,5,main]) completed. Took 1 mins 0.747 secs.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatch'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 58s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ltp73mojkag5q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure