See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/925/display/redirect?page=changes>
Changes:
[kirpichov] Adds support for SDF in ULR and the Java SDK.
[ekirpichov] Address easy review comments
[kirpichov] Handles memoization of encoded key/window in StateAccessor
------------------------------------------
[...truncated 67.31 MB...]
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Loading JAR files for task
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network:
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
submitTask
INFO: Received task ToKeyedWorkItem (1/1).
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (a977271f5bf8f1c3ed2060b35f0d913b) switched
from CREATED to DEPLOYING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Creating FileSystem stream leak safety net for task ToKeyedWorkItem
(1/1) (a977271f5bf8f1c3ed2060b35f0d913b) [DEPLOYING]
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Loading JAR files for task ToKeyedWorkItem (1/1)
(a977271f5bf8f1c3ed2060b35f0d913b) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network: ToKeyedWorkItem (1/1)
(a977271f5bf8f1c3ed2060b35f0d913b) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
submitTask
INFO: Received task PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1).
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) switched from CREATED to DEPLOYING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Creating FileSystem stream leak safety net for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) [DEPLOYING]
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Loading JAR files for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network:
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) [DEPLOYING].
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383) switched from
DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (a977271f5bf8f1c3ed2060b35f0d913b) switched
from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) switched from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383) switched from
DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: ToKeyedWorkItem (1/1) (a977271f5bf8f1c3ed2060b35f0d913b) switched
from DEPLOYING to RUNNING.
Jun 25, 2018 10:09:59 PM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
initializeState
INFO: No restore state for UnbounedSourceWrapper.
Jun 25, 2018 10:09:59 PM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
open
INFO: Unbounded Flink Source 0/1 is reading from sources:
[org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter@7f3dda1e]
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend <init>
INFO: Initializing heap keyed state backend with stream factory.
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
exceeded the 80 characters length limit and was truncated.
Jun 25, 2018 10:09:59 PM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
initializeState
INFO: No restore state for UnbounedSourceWrapper.
Jun 25, 2018 10:09:59 PM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
open
INFO: Unbounded Flink Source 0/1 is reading from sources:
[org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter@e5045f0]
Jun 25, 2018 10:09:59 PM
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend <init>
INFO: Initializing heap keyed state backend with stream factory.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6) [FINISHED]
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out
110aebad2e1529ee07b54f0b01464cb6.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(110aebad2e1529ee07b54f0b01464cb6) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383) switched from
RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383) [FINISHED]
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem 124cb0ec47ea539d8f79891ebaff3383.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (124cb0ec47ea539d8f79891ebaff3383) switched from
RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) [FINISHED]
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (a977271f5bf8f1c3ed2060b35f0d913b) switched
from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for ToKeyedWorkItem (1/1)
(a977271f5bf8f1c3ed2060b35f0d913b).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous)
34b23861eb9f039e27bb70fc1ed0ba9a.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task ToKeyedWorkItem
(1/1) (a977271f5bf8f1c3ed2060b35f0d913b) [FINISHED]
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task ToKeyedWorkItem a977271f5bf8f1c3ed2060b35f0d913b.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(34b23861eb9f039e27bb70fc1ed0ba9a) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: ToKeyedWorkItem (1/1) (a977271f5bf8f1c3ed2060b35f0d913b) switched
from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) [FINISHED]
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
6b0b6c3e015572ae8596d2de03d77a5c.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (6b0b6c3e015572ae8596d2de03d77a5c) switched from RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job
boundedreadfromunboundedsourcetest0testnodedup-jenkins-0625220959-6a9caee1
(16f3941d4bb97e963a2688814e907535) switched from state RUNNING to FINISHED.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.checkpoint.CheckpointCoordinator shutdown
INFO: Stopping checkpoint coordinator for job
16f3941d4bb97e963a2688814e907535.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore shutdown
INFO: Shutting down
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.dispatcher.Dispatcher
jobReachedGloballyTerminalState
INFO: Job 16f3941d4bb97e963a2688814e907535 reached globally terminal state
FINISHED.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.jobmaster.JobMaster
postStop
INFO: Stopping the JobMaster for job
boundedreadfromunboundedsourcetest0testnodedup-jenkins-0625220959-6a9caee1(16f3941d4bb97e963a2688814e907535).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job 16f3941d4bb97e963a2688814e907535.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.jobmaster.JobMaster
dissolveResourceManagerConnection
INFO: Close ResourceManager connection 7938cfd6673bcb25f18c5bdc12e8cf08:
JobManager is shutting down..
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.jobmaster.slotpool.SlotPool suspend
INFO: Suspending SlotPool.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.jobmaster.slotpool.SlotPool postStop
INFO: Stopping SlotPool.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.resourcemanager.ResourceManager
closeJobManagerConnection
INFO: Disconnect job manager
98e743d3deb9c84708f315d15332410a@akka://flink/user/jobmanager_271 for job
16f3941d4bb97e963a2688814e907535 from the resource manager.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership
INFO: JobManager for job 16f3941d4bb97e963a2688814e907535 with leader id
98e743d3deb9c84708f315d15332410a lost leadership.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
1dab0f88fe9288b24b4da7493c86b988, jobId: 16f3941d4bb97e963a2688814e907535).
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.minicluster.MiniCluster
closeAsync
INFO: Shutting down Flink Mini Cluster
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.taskexecutor.JobLeaderService removeJob
INFO: Remove job 16f3941d4bb97e963a2688814e907535 from job leader
monitoring.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job 16f3941d4bb97e963a2688814e907535.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.dispatcher.Dispatcher
postStop
INFO: Stopping dispatcher
akka://flink/user/dispatcher985a1196-317a-4f9a-8460-08dd96e304c3.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.rest.RestServerEndpoint
closeAsync
INFO: Shutting down rest endpoint.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.dispatcher.Dispatcher
terminateJobManagerRunners
INFO: Stopping all currently running jobs of dispatcher
akka://flink/user/dispatcher985a1196-317a-4f9a-8460-08dd96e304c3.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager close
INFO: Closing the SlotManager.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job 16f3941d4bb97e963a2688814e907535.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
shutDown
INFO: Shutting down stack trace sample coordinator.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager suspend
INFO: Suspending the SlotManager.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
postStop
INFO: Stopping TaskExecutor akka://flink/user/taskmanager_270.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager
unregisterTaskManager
INFO: Unregister TaskManager 84b0b68bc8927bba0655538f386ff970 from the
SlotManager.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.dispatcher.Dispatcher
lambda$postStop$0
INFO: Stopped dispatcher
akka://flink/user/dispatcher985a1196-317a-4f9a-8460-08dd96e304c3.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.io.disk.iomanager.IOManager shutdown
INFO: I/O manager removed spill file directory
/tmp/flink-io-c6a90ac6-e4c5-4777-b6ae-2feeb671cdcb
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.io.network.NetworkEnvironment shutdown
INFO: Shutting down the network environment and its components.
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$4
INFO: Removing cache directory /tmp/flink-web-ui
Jun 25, 2018 10:10:00 PM
org.apache.flink.runtime.taskexecutor.JobLeaderService stop
INFO: Stop job leader service.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
postStop
INFO: Stopped TaskExecutor akka://flink/user/taskmanager_270.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.blob.AbstractBlobCache
close
INFO: Shutting down BLOB cache
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.blob.AbstractBlobCache
close
INFO: Shutting down BLOB cache
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:33191
Jun 25, 2018 10:10:00 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$4
INFO: Stopped Akka RPC service.
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: Execution finished in 226 msecs
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: Final accumulator values:
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: __metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@bb4e26af
org.apache.beam.sdk.io.ReadTest > testBoundedPrimitiveDisplayData STANDARD_ERROR
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
org.apache.beam.sdk.io.ReadTest > testStreamingPrimitiveDisplayData
STANDARD_ERROR
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
org.apache.beam.sdk.io.AvroIOTest > testPrimitiveReadDisplayData STANDARD_ERROR
Jun 25, 2018 10:10:00 PM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
Gradle Test Executor 3 finished executing tests.
> Task :beam-runners-flink_2.11:validatesRunnerStreaming FAILED
230 tests completed, 8 failed, 2 skipped
Finished generating test XML results (0.07 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/test-results/validatesRunnerStreaming>
Generating HTML test report...
Finished generating test html results (0.069 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/reports/tests/validatesRunnerStreaming>
:beam-runners-flink_2.11:validatesRunnerStreaming (Thread[Task worker for ':'
Thread 11,5,main]) completed. Took 1 mins 56.771 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-flink_2.11:validatesRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/reports/tests/validatesRunnerStreaming/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16m 9s
44 actionable tasks: 40 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/psige5x6fouaw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
