[
https://issues.apache.org/jira/browse/APEXCORE-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490292#comment-15490292
]
Tushar Gosavi commented on APEXCORE-532:
----------------------------------------
Log for existing operator in DAG which got redeployed due to stream change.
{code}
2016-09-14 11:49:56,734 INFO com.datatorrent.stram.engine.StreamingContainer:
Deploy request:
[OperatorDeployInfo[id=1,name=Reader,type=INPUT,checkpoint={57d8ebbf00000077,
0,
0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=s1,bufferServer=ubuntu1504]]]]
2016-09-14 11:49:56,734 DEBUG com.datatorrent.stram.engine.StreamingContainer:
Restoring operator 1 to checkpoint 57d8ebbf00000077 stateless=false.
2016-09-14 11:49:57,279 DEBUG
com.datatorrent.bufferserver.internal.LogicalNode: BaseSeconds =
57d8ebbf00000000 and lBaseSeconds = 57d8ebbf00000000
2016-09-14 11:49:57,279 INFO com.datatorrent.stram.StreamingContainerParent:
begin window called 6330068481840513144 hex 57d8ebbf00000078
{code}
The log at new operator added
{code}
2016-09-14 11:49:56,689 INFO com.datatorrent.stram.engine.StreamingContainer:
Deploy request:
[OperatorDeployInfo[id=2,name=Splitter,type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=s1,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=words,streamId=s2,bufferServer=ubuntu1504]]]]
2016-09-14 11:49:56,691 DEBUG com.datatorrent.stram.engine.StreamingContainer:
Restoring operator 2 to checkpoint ffffffffffffffff stateless=false.
2016-09-14 11:49:57,190 DEBUG
com.datatorrent.bufferserver.internal.LogicalNode: BaseSeconds = 0 and
lBaseSeconds = ffffffff00000000
2016-09-14 11:49:57,486 INFO com.datatorrent.stram.StreamingContainerParent:
begin window called -4294967176 hex ffffffff00000078
{code}
> New dynamically added operator does not start with correct windowId.
> --------------------------------------------------------------------
>
> Key: APEXCORE-532
> URL: https://issues.apache.org/jira/browse/APEXCORE-532
> Project: Apache Apex Core
> Issue Type: Bug
> Reporter: Tushar Gosavi
> Priority: Critical
>
> During dynamic DAG change, If new operator is added and connected to existing
> operator, it does not starts with correct windowId. The baseSeconds is set to
> 0 causing windowId management problems at master effectively halting purge
> from buffer server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
