Hi Philippe, Thank you for the explanation. Will think about this as well.
On Fri, Sep 25, 2015 at 6:23 PM, Philippe Sevestre <[email protected]> wrote: > Hi Malaka, > > I´m quite aware of this distinction. My point is that smooks already > provides for multiple input formats and also operates in a streaming way - > this is why it is so widely used in ETL scenarios. > > The idea is that a "smooks"connector/transport" would hook into its > processing loop and feed the synapse engine with a new message for each > record. In this sense, both engines would operate more or less like a > coroutine pattern. > > Philippe. > > > On Fri, Sep 25, 2015 at 9:27 AM, Malaka Silva <[email protected]> wrote: > >> Hi Philippe, >> >> Thx for the input. But mediation(mediators) and connectors are at >> different layers. These are not tight coupled. >> >> Tran formation is part of ESB where as connector is an input or output >> component. >> >> [image: Inline image 1] >> >> On Fri, Sep 25, 2015 at 4:09 PM, Philippe Sevestre < >> [email protected]> wrote: >> >>> Hi, >>> >>> Since large files also come in non-XML formats, maybe you should also >>> consider using smooks at the file connector level. With that, formats like >>> EDI, CSV, etc would also benefit from the new file connector. >>> >>> Philippe >>> >>> On Fri, Sep 25, 2015 at 4:08 AM, Viraj Senevirathne <[email protected]> >>> wrote: >>> >>>> Hi Malaka, >>>> >>>> This STAX API [1]can be used to parse any xml file using streams which >>>> can be help full is we are processing a large xml file record after record. >>>> >>>> [1] http://www.ibm.com/developerworks/xml/library/x-stax1/index.html >>>> >>>> Thank you, >>>> >>>> On Fri, Sep 25, 2015 at 11:36 AM, Vivekananthan Sivanayagam < >>>> [email protected]> wrote: >>>> >>>>> Hi Malaka, >>>>> >>>>> This means , given a file should be divided into multiple parts and >>>>> then read one after the another each divided part? >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> *Thank youVivekananthan Sivanayagam* >>>>> >>>>> *Associate Software Engineer | WSO2* >>>>> >>>>> *E:[email protected] <e%[email protected]>* >>>>> *M:+94752786138 <%2B94752786138>* >>>>> >>>>> On Fri, Sep 25, 2015 at 10:41 AM, Malaka Silva <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Vivekananthan, >>>>>> >>>>>> We have the requirement to process a large file by processing one >>>>>> record at a time and the mediation of that record/message, then to >>>>>> proceed >>>>>> with the next. >>>>>> >>>>>> This is a valid and very common use case that can implement at File >>>>>> connector new version. >>>>>> >>>>>> Can we come up with an approach to address all such requirements? >>>>>> >>>>>> On Mon, Sep 7, 2015 at 7:48 PM, Vivekananthan Sivanayagam < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi all, >>>>>>> Thank you. I will consider these suggestion. >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> *Thank youVivekananthan Sivanayagam* >>>>>>> >>>>>>> *Associate Software Engineer | WSO2* >>>>>>> >>>>>>> *E:[email protected] <e%[email protected]>* >>>>>>> *M:+94752786138 <%2B94752786138>* >>>>>>> >>>>>>> On Mon, Sep 7, 2015 at 3:32 PM, Aiyadurai Rajeevan < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> We should be able to copy files as blocks and aggregate them >>>>>>>> together, This functionality would be more useful when deal with >>>>>>>> fairly big >>>>>>>> files. >>>>>>>> >>>>>>>> Thanks & Regards, >>>>>>>> S.A.Rajeevan >>>>>>>> Software Engineer WSO2 Inc >>>>>>>> E-Mail: [email protected] | Mobile : +94776411636 >>>>>>>> >>>>>>>> On Fri, Sep 4, 2015 at 3:03 PM, Cyril Rognon <[email protected] >>>>>>>> > wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> this is good news. We also have planned to enhance FileConnector : >>>>>>>>> >>>>>>>>> - add capability to process non xml files >>>>>>>>> - correct some errors whith xml prologue >>>>>>>>> - add capability to read from an archive (zip) - this one is in >>>>>>>>> your scope I suppose >>>>>>>>> >>>>>>>>> And more my be coming soon. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Cyril >>>>>>>>> >>>>>>>>> 2015-09-04 10:51 GMT+02:00 Vivekananthan Sivanayagam < >>>>>>>>> [email protected]>: >>>>>>>>> >>>>>>>>>> Hi All, >>>>>>>>>> >>>>>>>>>> I am going to implement File Connector Version2, So I have >>>>>>>>>> planned to improve existing file connector as well as add more >>>>>>>>>> operations >>>>>>>>>> with existing one.In current file connector, more parameters are >>>>>>>>>> required >>>>>>>>>> to do some operations (e.g.move operation). >>>>>>>>>> >>>>>>>>>> I found some issues with existing one. >>>>>>>>>> >>>>>>>>>> 1) The Copy operations does not work for zip files (after coping >>>>>>>>>> zip files , that file will be corrupted) . >>>>>>>>>> 2)Lot of parameters are required. >>>>>>>>>> 3)Archive operation does not work for remote files. >>>>>>>>>> >>>>>>>>>> So I am going to fix this problems in version2. >>>>>>>>>> >>>>>>>>>> And I have planned to add more functionalities. Such as >>>>>>>>>> >>>>>>>>>> 1)List all files name inside a folder for a given folder(In >>>>>>>>>> current File Connector , This operation is working for a zip files). >>>>>>>>>> 2)Compress a folder including remote file(ftp). >>>>>>>>>> 3)Arrange the files in ascending or descending order. >>>>>>>>>> 4)Hide a folder. >>>>>>>>>> >>>>>>>>>> Please give me some suggestions and what are the operations I >>>>>>>>>> have to consider in File Connector version 2. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Thank you >>>>>>>>>> Vivekananthan Sivanayagam >>>>>>>>>> Associate Software Engineer | WSO2 >>>>>>>>>> E:[email protected] >>>>>>>>>> M:+94752786138 >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Architecture mailing list >>>>>>>>>> [email protected] >>>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Architecture mailing list >>>>>>>>> [email protected] >>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Best Regards, >>>>>> >>>>>> Malaka Silva >>>>>> Senior Tech Lead >>>>>> M: +94 777 219 791 >>>>>> Tel : 94 11 214 5345 >>>>>> Fax :94 11 2145300 >>>>>> Skype : malaka.sampath.silva >>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>> >>>>>> WSO2, Inc. >>>>>> lean . enterprise . middleware >>>>>> http://www.wso2.com/ >>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>> >>>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>>> this email only if it is absolutely necessary. >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Viraj Senevirathne >>>> Software Engineer; WSO2, Inc. >>>> >>>> Mobile : +94 71 958 0269 >>>> Email : [email protected] >>>> >>>> _______________________________________________ >>>> Architecture mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>> >>>> >>> >>> >>> -- >>> >>> www.lighthouse.com.br >>> Philippe Sevestre ([email protected] <[email protected]>) >>> Tel.: +55 (11) 4063-0968 >>> Cel.: +55 (11) 9-9735-2586 >>> Av. Brig. Faria Lima, 1461 - 4o andar 01452-002 São Paulo, SP - Brasil >>> >> >> >> >> -- >> >> Best Regards, >> >> Malaka Silva >> Senior Tech Lead >> M: +94 777 219 791 >> Tel : 94 11 214 5345 >> Fax :94 11 2145300 >> Skype : malaka.sampath.silva >> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >> Blog : http://mrmalakasilva.blogspot.com/ >> >> WSO2, Inc. >> lean . enterprise . middleware >> http://www.wso2.com/ >> http://www.wso2.com/about/team/malaka-silva/ >> <http://wso2.com/about/team/malaka-silva/> >> >> Save a tree -Conserve nature & Save the world for your future. Print this >> email only if it is absolutely necessary. >> > > > > -- > > www.lighthouse.com.br > Philippe Sevestre ([email protected] <[email protected]>) > Tel.: +55 (11) 4063-0968 > Cel.: +55 (11) 9-9735-2586 > Av. Brig. Faria Lima, 1461 - 4o andar 01452-002 São Paulo, SP - Brasil > -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary.
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
