Batches are processed sequentially, but each batch is partitioned (and therefore processed in parallel). As a batch is processed, it can be repartitioned an arbitrary number of times throughout the Trident topology.
On Wed, Apr 16, 2014 at 4:28 PM, Raphael Hsieh <[email protected]> wrote: > Hi I found myself being confused on how to think of Storm/Trident > processing batches. > Are batches processed sequentially, but split into multiple partitions > that are spread throughout the worker nodes ? > > Or are batches processed in parrallel and spread among worker nodes to be > split into partitions within each host running on multiple threads ? > > Thanks! > -- > Raphael Hsieh > > > > -- Twitter: @nathanmarz http://nathanmarz.com
