Thanks Tom for the quick reply. I need a single spout, based on IRichSpout, and parallelism 4 for my Trident functions per worker. If I do not do a shuffle the spout parallelism is set to 4 as well. It seems that I need the shuffle to have separate parallelism for the spout and functions. I would like to avoid serialization so localOrShuffle would be ideal, but not apparently an option in Trident.
On 24 February 2014 22:17, Tom Brown <[email protected]> wrote: > On trident, all operations happen locally unless you explicitly > repartition (shuffle, partition by key, etc) > > > On Monday, February 24, 2014, Robert Turner <[email protected]> wrote: > >> This appears to be missing from Stream, is there any way to specify this >> or is there a reason why this is not possible with Trident. >> >> -- >> Cheers >> Rob. >> > -- Cheers Rob.
