Hi Malka, Yeah point taken. Then we will have to optimize this for large files. May be we can process files in blocking way one file after another if it is a large file.
On Tue, Sep 15, 2015 at 10:12 PM, Malaka Silva <[email protected]> wrote: > Hi Viraj, > > We can do what you have mentioned with move operations and moving after > the processing. > > But in inbound it'll first build and inject to the sequence. > > On Tue, Sep 15, 2015 at 9:42 PM, Viraj Senevirathne <[email protected]> > wrote: > >> Hi Malaka, >> Yeah it is the main problem when implementing it in existing vfs >> transport too. >> >> But if we consider vfs transport when we move files after processing we >> directly move the file without injecting it to mediation engine. >> >> Will it be possible to have a option to bypass mediation engine and >> directly transfer files to the destination with streaming. WDYT? >> >> On Tue, Sep 15, 2015 at 9:17 PM, Malaka Silva <[email protected]> wrote: >> >>> +1 we can optimize this for local files since will be using NIO. >>> >>> However in the case of reading it does not make a difference since >>> anyway we need to build the message. WDYT? >>> >>> On Tue, Sep 15, 2015 at 9:13 PM, Viraj Senevirathne <[email protected]> >>> wrote: >>> >>>> Hi Kalyani, >>>> >>>> It would be very useful if you can pay special attention to large file >>>> transfer mechanisms. In existing vfs transport there are some problems >>>> encountered when transferring large files. I think it would be great if we >>>> can implement steaming support for large files as it will improve the >>>> memory usage of ESB while transferring the file. >>>> >>>> Thank you, >>>> >>>> On Tue, Sep 15, 2015 at 8:43 PM, Malaka Silva <[email protected]> wrote: >>>> >>>>> Hi Kalyani, >>>>> >>>>> Also append file is a useful function. Can you provide some details >>>>> how are you planning to implement VFS listener using NIO? >>>>> >>>>> On Tue, Sep 15, 2015 at 3:32 PM, Kalyani Yogeswaranathan < >>>>> [email protected]> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I am going to implement *Local File Inbound*/*Connector* to improve >>>>>> *local >>>>>> file processing*. So I have planned to implement polling inbound and >>>>>> connector using *java.nio* with basic operations such as, >>>>>> >>>>>> - Copy >>>>>> - Delete >>>>>> - Move >>>>>> - Read >>>>>> - Rename >>>>>> >>>>>> Can you give some suggestion or guidance on this? >>>>>> >>>>>> Thank you. >>>>>> >>>>>> -- >>>>>> >>>>>> *Kalyani Yogeswaranathan* >>>>>> >>>>>> *Associate software engineer* >>>>>> *WSO2 Inc.* >>>>>> >>>>>> *Mobile: 0776390284 <0776390284>* >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> Best Regards, >>>>> >>>>> Malaka Silva >>>>> Senior Tech Lead >>>>> M: +94 777 219 791 >>>>> Tel : 94 11 214 5345 >>>>> Fax :94 11 2145300 >>>>> Skype : malaka.sampath.silva >>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>> >>>>> WSO2, Inc. >>>>> lean . enterprise . middleware >>>>> http://www.wso2.com/ >>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>> <http://wso2.com/about/team/malaka-silva/> >>>>> >>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>> this email only if it is absolutely necessary. >>>>> >>>>> _______________________________________________ >>>>> Architecture mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>> >>>>> >>>> >>>> >>>> -- >>>> Viraj Senevirathne >>>> Software Engineer; WSO2, Inc. >>>> >>>> Mobile : +94 71 958 0269 >>>> Email : [email protected] >>>> >>>> _______________________________________________ >>>> Architecture mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>> >>>> >>> >>> >>> -- >>> >>> Best Regards, >>> >>> Malaka Silva >>> Senior Tech Lead >>> M: +94 777 219 791 >>> Tel : 94 11 214 5345 >>> Fax :94 11 2145300 >>> Skype : malaka.sampath.silva >>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>> Blog : http://mrmalakasilva.blogspot.com/ >>> >>> WSO2, Inc. >>> lean . enterprise . middleware >>> http://www.wso2.com/ >>> http://www.wso2.com/about/team/malaka-silva/ >>> <http://wso2.com/about/team/malaka-silva/> >>> >>> Save a tree -Conserve nature & Save the world for your future. Print >>> this email only if it is absolutely necessary. >>> >>> _______________________________________________ >>> Architecture mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>> >>> >> >> >> -- >> Viraj Senevirathne >> Software Engineer; WSO2, Inc. >> >> Mobile : +94 71 958 0269 >> Email : [email protected] >> >> _______________________________________________ >> Architecture mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >> >> > > > -- > > Best Regards, > > Malaka Silva > Senior Tech Lead > M: +94 777 219 791 > Tel : 94 11 214 5345 > Fax :94 11 2145300 > Skype : malaka.sampath.silva > LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 > Blog : http://mrmalakasilva.blogspot.com/ > > WSO2, Inc. > lean . enterprise . middleware > http://www.wso2.com/ > http://www.wso2.com/about/team/malaka-silva/ > <http://wso2.com/about/team/malaka-silva/> > > Save a tree -Conserve nature & Save the world for your future. Print this > email only if it is absolutely necessary. > > _______________________________________________ > Architecture mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture > > -- Viraj Senevirathne Software Engineer; WSO2, Inc. Mobile : +94 71 958 0269 Email : [email protected]
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
