On Wed, Oct 26, 2011 at 9:52 PM, ebinsingh <[email protected]> wrote: > Hi, > > I have a file of 300,000 records and i use the split mechanism of Camel to > split them and sends each record to a processer. > Does Camel store these records on a heap or somewhere before it sends them > to the processer. How does Camel splitter internally work. > > I want to make sure that the Splitter does not eat up the memory. >
The splitter by default will build up a list, but you can enable streaming mode, so it uses a iterator. http://camel.apache.org/splitter.html Also the splitte can aggregate the messages back again, so you do not need to use a separate aggregator. Instead just supply a aggregation strategy to the splitter. ( like a composed message processor EIP - http://camel.apache.org/composed-message-processor.html, however I can see the wiki page hasn't been updated to shown this ) Camel in Action book chapter 8 and 10 covers this in much more details. > Please provide some insight into this. > > Thanks & regards, > Ebe > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Spliter-in-Camel-tp4940967p4940967.html > Sent from the Camel - Users mailing list archive at Nabble.com. > -- Claus Ibsen ----------------- FuseSource Email: [email protected] Web: http://fusesource.com Twitter: davsclaus, fusenews Blog: http://davsclaus.blogspot.com/ Author of Camel in Action: http://www.manning.com/ibsen/
