Malaka, Thanks for the information!
When splitting the larger file into smaller files, how do you create the smaller files with a name based on the parent file? For example, if the source file is named “documentABC.txt”, I would like the smaller files to be named “documentABC_0001.txt” and “documentABC_0002.txt” etc. I’m having a difficult time figuring out how to access the name of the current file being processed by the VFS listener. Thanks, - Rudy From: Malaka Silva [mailto:[email protected]] Sent: Thursday, August 06, 2015 1:57 AM To: Rudy Hilado Cc: WSO2 Developers' List Subject: Re: [Dev] Pause/restart when processing a large file Hi Rudy, I am afraid currently this is not supported out of the box. However you can achieve your requirement with the following solution. You can split the file and put in a separate folder (One entry in a file). eg:- VFS Listerner [3] -> Iterator mediator [4] -> File Connector [1][2] Take one file and process it. eg:- VFS listener [3] Following doc links will help you to do this. [1] https://storepreview.wso2.com/store/assets/esbconnector/f0550184-88c4-4d5e-b73f-ea51b1b5ab98 [2] https://docs.wso2.com/display/ESBCONNECTORS/Working+with+the+File+Connector#WorkingwiththeFileConnector-create [3] https://docs.wso2.com/display/ESB481/VFS+Transport [4] https://docs.wso2.com/display/ESB481/Iterate+Mediator On Wed, Aug 5, 2015 at 8:52 PM, Rudy Hilado <[email protected]> wrote: Is it possible in the WSO2 ESB to process a large file (with each line representing a single record/message), and stop or pause the processing within the file, then restart where it left off? (using the Smooks mediator and/or Iterate mediator, or any other mechanism) It appears that if you are processing a large file (say with 10K entries) you cannot stop or pause the processing (or if the ESB is brought down in the middle of processing the file), and then restart where it was stopped. Upon restarting either the whole file has to be reprocessed, or the file is dumped to the error folder and skipped. Is this correct? Thanks for any help on this. - Rudy _______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary.
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
