Oh read these blogs about splitting big XML files with Camel http://davsclaus.blogspot.com/2011/11/splitting-big-xml-files-with-apache_24.html http://davsclaus.blogspot.com/2011/11/splitting-big-xml-files-with-apache.html
On Fri, Dec 9, 2011 at 11:50 AM, Claus Ibsen <[email protected]> wrote: > On Fri, Dec 9, 2011 at 11:31 AM, diwakar <[email protected]> wrote: >> Hi, >> >> In servicemix, if we have big files(300 mb), the file was in the >> content of the message from file poller and the message was moved around in >> the NMR based on the flow. Even doubling the memory if a copy was made in >> some EIPs. >> Does Camel file/ftp/xsl components support handling based on the >> streams. (So that there are no huge memory requirements). >> Please let me know your comment. >> > > Yes. Camel just routes the java.io.File handle. > And supports streams such as FileInputStream to read the file in chunks. > > In terms of XSLT and XML components, then its often whether they > require to load the entire content > into a DOMSource or something like that. > > Camel has support for StAX, SAX as well, so if the XSL / XML > components can reverage those types, then they are preferred. > > The FTP component supports to download the files to a local work > directory, instead of streaming into memory. > For that you need to enable the localWorkDirectory option. > > > >> With Best Regards, >> Diwakar >> >> >> -- >> View this message in context: >> http://camel.465427.n5.nabble.com/Huge-file-support-tp5061318p5061318.html >> Sent from the Camel - Users mailing list archive at Nabble.com. > > > > -- > Claus Ibsen > ----------------- > FuseSource > Email: [email protected] > Web: http://fusesource.com > Twitter: davsclaus, fusenews > Blog: http://davsclaus.blogspot.com/ > Author of Camel in Action: http://www.manning.com/ibsen/ -- Claus Ibsen ----------------- FuseSource Email: [email protected] Web: http://fusesource.com Twitter: davsclaus, fusenews Blog: http://davsclaus.blogspot.com/ Author of Camel in Action: http://www.manning.com/ibsen/
