Hi All, I have attached link [1] about details on Local File Connector/Inbound.
[1] https://docs.google.com/a/wso2.com/document/d/1rQDjOVPAwq4m7B0zLBrqGFwYb-TLJeD-OdM9a7xJoCY/edit?usp=sharing Is this OK? Can anyone guide on this? Thanks On Wed, Sep 16, 2015 at 5:33 AM, Malaka Silva <[email protected]> wrote: > Hi All, > > The topic is for local files. IMO we should not worry about the file sizes > hear since there is no network communication involved. Since will be using > NIO we can get the OS level optimizations directly with Java. One of the > reasons for doing is to optimize local operations eliminating common vfs. > > On Tue, Sep 15, 2015 at 11:21 PM, Hariprasath Thanarajah < > [email protected]> wrote: > >> Hi Viraj, >> >> +1 for Viraj suggestion. But also need to think about in the processing >> part as well. >> >> >> >> On Tue, Sep 15, 2015 at 11:09 PM, Viraj Senevirathne <[email protected]> >> wrote: >> >>> Hi Hariprasanth, >>> It is a very good idea. But if we want to do some processing on the >>> content of the file we will have to build the content inside the ESB. For >>> other scenarios if we could chunk the large and transfer them it would be >>> good thing. >>> >>> On Tue, Sep 15, 2015 at 10:45 PM, Kalyani Yogeswaranathan < >>> [email protected]> wrote: >>> >>>> Hi Malaka/ Viraj >>>> >>>> Thanks for your reply. I'll consider these useful functions and i'll >>>> provide the brief details as soon as possible. >>>> >>>> Thank you. >>>> >>>> On Tue, Sep 15, 2015 at 10:20 PM, Viraj Senevirathne <[email protected]> >>>> wrote: >>>> >>>>> Hi Malka, >>>>> Yeah point taken. Then we will have to optimize this for large files. >>>>> May be we can process files in blocking way one file after another if it >>>>> is >>>>> a large file. >>>>> >>>>> On Tue, Sep 15, 2015 at 10:12 PM, Malaka Silva <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Viraj, >>>>>> >>>>>> We can do what you have mentioned with move operations and moving >>>>>> after the processing. >>>>>> >>>>>> But in inbound it'll first build and inject to the sequence. >>>>>> >>>>>> On Tue, Sep 15, 2015 at 9:42 PM, Viraj Senevirathne <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Hi Malaka, >>>>>>> Yeah it is the main problem when implementing it in existing vfs >>>>>>> transport too. >>>>>>> >>>>>>> But if we consider vfs transport when we move files after processing >>>>>>> we directly move the file without injecting it to mediation engine. >>>>>>> >>>>>>> Will it be possible to have a option to bypass mediation engine and >>>>>>> directly transfer files to the destination with streaming. WDYT? >>>>>>> >>>>>>> On Tue, Sep 15, 2015 at 9:17 PM, Malaka Silva <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> +1 we can optimize this for local files since will be using NIO. >>>>>>>> >>>>>>>> However in the case of reading it does not make a difference since >>>>>>>> anyway we need to build the message. WDYT? >>>>>>>> >>>>>>>> On Tue, Sep 15, 2015 at 9:13 PM, Viraj Senevirathne < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi Kalyani, >>>>>>>>> >>>>>>>>> It would be very useful if you can pay special attention to large >>>>>>>>> file transfer mechanisms. In existing vfs transport there are some >>>>>>>>> problems >>>>>>>>> encountered when transferring large files. I think it would be great >>>>>>>>> if we >>>>>>>>> can implement steaming support for large files as it will improve the >>>>>>>>> memory usage of ESB while transferring the file. >>>>>>>>> >>>>>>>>> Thank you, >>>>>>>>> >>>>>>>>> On Tue, Sep 15, 2015 at 8:43 PM, Malaka Silva <[email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Kalyani, >>>>>>>>>> >>>>>>>>>> Also append file is a useful function. Can you provide some >>>>>>>>>> details how are you planning to implement VFS listener using NIO? >>>>>>>>>> >>>>>>>>>> On Tue, Sep 15, 2015 at 3:32 PM, Kalyani Yogeswaranathan < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Hi All, >>>>>>>>>>> >>>>>>>>>>> I am going to implement *Local File Inbound*/*Connector* to >>>>>>>>>>> improve *local file processing*. So I have planned to implement >>>>>>>>>>> polling inbound and connector using *java.nio* with basic >>>>>>>>>>> operations such as, >>>>>>>>>>> >>>>>>>>>>> - Copy >>>>>>>>>>> - Delete >>>>>>>>>>> - Move >>>>>>>>>>> - Read >>>>>>>>>>> - Rename >>>>>>>>>>> >>>>>>>>>>> Can you give some suggestion or guidance on this? >>>>>>>>>>> >>>>>>>>>>> Thank you. >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> >>>>>>>>>>> *Kalyani Yogeswaranathan* >>>>>>>>>>> >>>>>>>>>>> *Associate software engineer* >>>>>>>>>>> *WSO2 Inc.* >>>>>>>>>>> >>>>>>>>>>> *Mobile: 0776390284 <0776390284>* >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>>> Best Regards, >>>>>>>>>> >>>>>>>>>> Malaka Silva >>>>>>>>>> Senior Tech Lead >>>>>>>>>> M: +94 777 219 791 >>>>>>>>>> Tel : 94 11 214 5345 >>>>>>>>>> Fax :94 11 2145300 >>>>>>>>>> Skype : malaka.sampath.silva >>>>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>>>>>> >>>>>>>>>> WSO2, Inc. >>>>>>>>>> lean . enterprise . middleware >>>>>>>>>> http://www.wso2.com/ >>>>>>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>>>>>> >>>>>>>>>> Save a tree -Conserve nature & Save the world for your future. >>>>>>>>>> Print this email only if it is absolutely necessary. >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Architecture mailing list >>>>>>>>>> [email protected] >>>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Viraj Senevirathne >>>>>>>>> Software Engineer; WSO2, Inc. >>>>>>>>> >>>>>>>>> Mobile : +94 71 958 0269 >>>>>>>>> Email : [email protected] >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Architecture mailing list >>>>>>>>> [email protected] >>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> >>>>>>>> Best Regards, >>>>>>>> >>>>>>>> Malaka Silva >>>>>>>> Senior Tech Lead >>>>>>>> M: +94 777 219 791 >>>>>>>> Tel : 94 11 214 5345 >>>>>>>> Fax :94 11 2145300 >>>>>>>> Skype : malaka.sampath.silva >>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>>>> >>>>>>>> WSO2, Inc. >>>>>>>> lean . enterprise . middleware >>>>>>>> http://www.wso2.com/ >>>>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>>>> >>>>>>>> Save a tree -Conserve nature & Save the world for your future. >>>>>>>> Print this email only if it is absolutely necessary. >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Architecture mailing list >>>>>>>> [email protected] >>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Viraj Senevirathne >>>>>>> Software Engineer; WSO2, Inc. >>>>>>> >>>>>>> Mobile : +94 71 958 0269 >>>>>>> Email : [email protected] >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Architecture mailing list >>>>>>> [email protected] >>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Best Regards, >>>>>> >>>>>> Malaka Silva >>>>>> Senior Tech Lead >>>>>> M: +94 777 219 791 >>>>>> Tel : 94 11 214 5345 >>>>>> Fax :94 11 2145300 >>>>>> Skype : malaka.sampath.silva >>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>> >>>>>> WSO2, Inc. >>>>>> lean . enterprise . middleware >>>>>> http://www.wso2.com/ >>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>> >>>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>>> this email only if it is absolutely necessary. >>>>>> >>>>>> _______________________________________________ >>>>>> Architecture mailing list >>>>>> [email protected] >>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Viraj Senevirathne >>>>> Software Engineer; WSO2, Inc. >>>>> >>>>> Mobile : +94 71 958 0269 >>>>> Email : [email protected] >>>>> >>>>> _______________________________________________ >>>>> Architecture mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> *Kalyani Yogeswaranathan* >>>> >>>> *Associate software engineer* >>>> *WSO2 Inc.* >>>> >>>> *Mobile: 0776390284 <0776390284>* >>>> >>>> _______________________________________________ >>>> Architecture mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>> >>>> >>> >>> >>> -- >>> Viraj Senevirathne >>> Software Engineer; WSO2, Inc. >>> >>> Mobile : +94 71 958 0269 >>> Email : [email protected] >>> >>> _______________________________________________ >>> Architecture mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>> >>> >> >> >> -- >> >> >> *Thank you and Regards**Hariprasath Thanarajah* >> Associate Software Engineer | WSO2 >> E: [email protected] >> M: +94752806528 >> >> >> _______________________________________________ >> Architecture mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >> >> > > > -- > > Best Regards, > > Malaka Silva > Senior Tech Lead > M: +94 777 219 791 > Tel : 94 11 214 5345 > Fax :94 11 2145300 > Skype : malaka.sampath.silva > LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 > Blog : http://mrmalakasilva.blogspot.com/ > > WSO2, Inc. > lean . enterprise . middleware > http://www.wso2.com/ > http://www.wso2.com/about/team/malaka-silva/ > <http://wso2.com/about/team/malaka-silva/> > > Save a tree -Conserve nature & Save the world for your future. Print this > email only if it is absolutely necessary. > > _______________________________________________ > Architecture mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture > > -- *Kalyani Yogeswaranathan* *Associate software engineer* *WSO2 Inc.* *Mobile: 0776390284*
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
