I have created JIRA STORM-245 - Implement localOrShuffle() on Stream for performance <https://issues.apache.org/jira/browse/STORM-245>.
Thanks you all for your help. On 24 February 2014 23:15, P. Taylor Goetz <[email protected]> wrote: > Hi Rob, > > You are correct about needing a repartitioning operation in order for the > spout to have a different parallelism. > > Can you file a JIRA to implement localOrShuffle()? > > Taylor > > On Feb 24, 2014, at 5:31 PM, Robert Turner <[email protected]> wrote: > > Thanks Tom for the quick reply. > > I need a single spout, based on IRichSpout, and parallelism 4 for my > Trident functions per worker. If I do not do a shuffle the spout > parallelism is set to 4 as well. It seems that I need the shuffle to have > separate parallelism for the spout and functions. I would like to avoid > serialization so localOrShuffle would be ideal, but not apparently an > option in Trident. > > > On 24 February 2014 22:17, Tom Brown <[email protected]> wrote: > >> On trident, all operations happen locally unless you explicitly >> repartition (shuffle, partition by key, etc) >> >> >> On Monday, February 24, 2014, Robert Turner <[email protected]> wrote: >> >>> This appears to be missing from Stream, is there any way to specify this >>> or is there a reason why this is not possible with Trident. >>> >>> -- >>> Cheers >>> Rob. >>> >> > > > -- > Cheers > Rob. > > -- Cheers Rob.
