Hi All, The topic is for local files. IMO we should not worry about the file sizes hear since there is no network communication involved. Since will be using NIO we can get the OS level optimizations directly with Java. One of the reasons for doing is to optimize local operations eliminating common vfs.
On Tue, Sep 15, 2015 at 11:21 PM, Hariprasath Thanarajah < [email protected]> wrote: > Hi Viraj, > > +1 for Viraj suggestion. But also need to think about in the processing > part as well. > > > > On Tue, Sep 15, 2015 at 11:09 PM, Viraj Senevirathne <[email protected]> > wrote: > >> Hi Hariprasanth, >> It is a very good idea. But if we want to do some processing on the >> content of the file we will have to build the content inside the ESB. For >> other scenarios if we could chunk the large and transfer them it would be >> good thing. >> >> On Tue, Sep 15, 2015 at 10:45 PM, Kalyani Yogeswaranathan < >> [email protected]> wrote: >> >>> Hi Malaka/ Viraj >>> >>> Thanks for your reply. I'll consider these useful functions and i'll >>> provide the brief details as soon as possible. >>> >>> Thank you. >>> >>> On Tue, Sep 15, 2015 at 10:20 PM, Viraj Senevirathne <[email protected]> >>> wrote: >>> >>>> Hi Malka, >>>> Yeah point taken. Then we will have to optimize this for large files. >>>> May be we can process files in blocking way one file after another if it is >>>> a large file. >>>> >>>> On Tue, Sep 15, 2015 at 10:12 PM, Malaka Silva <[email protected]> wrote: >>>> >>>>> Hi Viraj, >>>>> >>>>> We can do what you have mentioned with move operations and moving >>>>> after the processing. >>>>> >>>>> But in inbound it'll first build and inject to the sequence. >>>>> >>>>> On Tue, Sep 15, 2015 at 9:42 PM, Viraj Senevirathne <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Malaka, >>>>>> Yeah it is the main problem when implementing it in existing vfs >>>>>> transport too. >>>>>> >>>>>> But if we consider vfs transport when we move files after processing >>>>>> we directly move the file without injecting it to mediation engine. >>>>>> >>>>>> Will it be possible to have a option to bypass mediation engine and >>>>>> directly transfer files to the destination with streaming. WDYT? >>>>>> >>>>>> On Tue, Sep 15, 2015 at 9:17 PM, Malaka Silva <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> +1 we can optimize this for local files since will be using NIO. >>>>>>> >>>>>>> However in the case of reading it does not make a difference since >>>>>>> anyway we need to build the message. WDYT? >>>>>>> >>>>>>> On Tue, Sep 15, 2015 at 9:13 PM, Viraj Senevirathne <[email protected] >>>>>>> > wrote: >>>>>>> >>>>>>>> Hi Kalyani, >>>>>>>> >>>>>>>> It would be very useful if you can pay special attention to large >>>>>>>> file transfer mechanisms. In existing vfs transport there are some >>>>>>>> problems >>>>>>>> encountered when transferring large files. I think it would be great >>>>>>>> if we >>>>>>>> can implement steaming support for large files as it will improve the >>>>>>>> memory usage of ESB while transferring the file. >>>>>>>> >>>>>>>> Thank you, >>>>>>>> >>>>>>>> On Tue, Sep 15, 2015 at 8:43 PM, Malaka Silva <[email protected]> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Kalyani, >>>>>>>>> >>>>>>>>> Also append file is a useful function. Can you provide some >>>>>>>>> details how are you planning to implement VFS listener using NIO? >>>>>>>>> >>>>>>>>> On Tue, Sep 15, 2015 at 3:32 PM, Kalyani Yogeswaranathan < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hi All, >>>>>>>>>> >>>>>>>>>> I am going to implement *Local File Inbound*/*Connector* to >>>>>>>>>> improve *local file processing*. So I have planned to implement >>>>>>>>>> polling inbound and connector using *java.nio* with basic >>>>>>>>>> operations such as, >>>>>>>>>> >>>>>>>>>> - Copy >>>>>>>>>> - Delete >>>>>>>>>> - Move >>>>>>>>>> - Read >>>>>>>>>> - Rename >>>>>>>>>> >>>>>>>>>> Can you give some suggestion or guidance on this? >>>>>>>>>> >>>>>>>>>> Thank you. >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>>> *Kalyani Yogeswaranathan* >>>>>>>>>> >>>>>>>>>> *Associate software engineer* >>>>>>>>>> *WSO2 Inc.* >>>>>>>>>> >>>>>>>>>> *Mobile: 0776390284 <0776390284>* >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> Best Regards, >>>>>>>>> >>>>>>>>> Malaka Silva >>>>>>>>> Senior Tech Lead >>>>>>>>> M: +94 777 219 791 >>>>>>>>> Tel : 94 11 214 5345 >>>>>>>>> Fax :94 11 2145300 >>>>>>>>> Skype : malaka.sampath.silva >>>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>>>>> >>>>>>>>> WSO2, Inc. >>>>>>>>> lean . enterprise . middleware >>>>>>>>> http://www.wso2.com/ >>>>>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>>>>> >>>>>>>>> Save a tree -Conserve nature & Save the world for your future. >>>>>>>>> Print this email only if it is absolutely necessary. >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Architecture mailing list >>>>>>>>> [email protected] >>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Viraj Senevirathne >>>>>>>> Software Engineer; WSO2, Inc. >>>>>>>> >>>>>>>> Mobile : +94 71 958 0269 >>>>>>>> Email : [email protected] >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Architecture mailing list >>>>>>>> [email protected] >>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> Best Regards, >>>>>>> >>>>>>> Malaka Silva >>>>>>> Senior Tech Lead >>>>>>> M: +94 777 219 791 >>>>>>> Tel : 94 11 214 5345 >>>>>>> Fax :94 11 2145300 >>>>>>> Skype : malaka.sampath.silva >>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>>> >>>>>>> WSO2, Inc. >>>>>>> lean . enterprise . middleware >>>>>>> http://www.wso2.com/ >>>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>>> >>>>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>>>> this email only if it is absolutely necessary. >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Architecture mailing list >>>>>>> [email protected] >>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Viraj Senevirathne >>>>>> Software Engineer; WSO2, Inc. >>>>>> >>>>>> Mobile : +94 71 958 0269 >>>>>> Email : [email protected] >>>>>> >>>>>> _______________________________________________ >>>>>> Architecture mailing list >>>>>> [email protected] >>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> Best Regards, >>>>> >>>>> Malaka Silva >>>>> Senior Tech Lead >>>>> M: +94 777 219 791 >>>>> Tel : 94 11 214 5345 >>>>> Fax :94 11 2145300 >>>>> Skype : malaka.sampath.silva >>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>> >>>>> WSO2, Inc. >>>>> lean . enterprise . middleware >>>>> http://www.wso2.com/ >>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>> <http://wso2.com/about/team/malaka-silva/> >>>>> >>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>> this email only if it is absolutely necessary. >>>>> >>>>> _______________________________________________ >>>>> Architecture mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>> >>>>> >>>> >>>> >>>> -- >>>> Viraj Senevirathne >>>> Software Engineer; WSO2, Inc. >>>> >>>> Mobile : +94 71 958 0269 >>>> Email : [email protected] >>>> >>>> _______________________________________________ >>>> Architecture mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>> >>>> >>> >>> >>> -- >>> >>> *Kalyani Yogeswaranathan* >>> >>> *Associate software engineer* >>> *WSO2 Inc.* >>> >>> *Mobile: 0776390284 <0776390284>* >>> >>> _______________________________________________ >>> Architecture mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>> >>> >> >> >> -- >> Viraj Senevirathne >> Software Engineer; WSO2, Inc. >> >> Mobile : +94 71 958 0269 >> Email : [email protected] >> >> _______________________________________________ >> Architecture mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >> >> > > > -- > > > *Thank you and Regards**Hariprasath Thanarajah* > Associate Software Engineer | WSO2 > E: [email protected] > M: +94752806528 > > > _______________________________________________ > Architecture mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture > > -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary.
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
