[ 
https://issues.apache.org/jira/browse/STORM-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932614#comment-15932614
 ] 

Robert Joseph Evans commented on STORM-2422:
--------------------------------------------

[~kabhwan],

The only real thing to be careful with pulling it into another branch is making 
sure to set the serialVersionUID correctly.  I tested it for 2.x and I know 
that it works.  I think that 1.x will have the same ID as 2.x, but because we 
were not specifying it before I really would want to check before back-porting.

> Serialized Trident topology size does not grow linerarly
> --------------------------------------------------------
>
>                 Key: STORM-2422
>                 URL: https://issues.apache.org/jira/browse/STORM-2422
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: trident
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 2.0.0
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Many of the Trident bolts contain a serialized version of the entire trident 
> graph.  This means that as the size of the graph grows, and the number of 
> bolts grows with it, that the serialized topology grows quadraticly.
> The bolt only uses a small portion of that graph so we can filter out most of 
> that.
> As an extreme example a topology with 1000 Bolts (4000 nodes in the graph) 
> can grow to be over 1GB in size.  If we trim out the parts of the graph that 
> are not needed the serialized topology is < 40MB in size.
> This is a backwards compatible change, because we are only stripping out data 
> that is never touched by the bolt anyways.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to