Hi all, I think, if the file is too large we can divide it into chunk and aggregate the whole file.
On Tue, Sep 15, 2015 at 10:20 PM, Viraj Senevirathne <[email protected]> wrote: > Hi Malka, > Yeah point taken. Then we will have to optimize this for large files. May > be we can process files in blocking way one file after another if it is a > large file. > > On Tue, Sep 15, 2015 at 10:12 PM, Malaka Silva <[email protected]> wrote: > >> Hi Viraj, >> >> We can do what you have mentioned with move operations and moving after >> the processing. >> >> But in inbound it'll first build and inject to the sequence. >> >> On Tue, Sep 15, 2015 at 9:42 PM, Viraj Senevirathne <[email protected]> >> wrote: >> >>> Hi Malaka, >>> Yeah it is the main problem when implementing it in existing vfs >>> transport too. >>> >>> But if we consider vfs transport when we move files after processing we >>> directly move the file without injecting it to mediation engine. >>> >>> Will it be possible to have a option to bypass mediation engine and >>> directly transfer files to the destination with streaming. WDYT? >>> >>> On Tue, Sep 15, 2015 at 9:17 PM, Malaka Silva <[email protected]> wrote: >>> >>>> +1 we can optimize this for local files since will be using NIO. >>>> >>>> However in the case of reading it does not make a difference since >>>> anyway we need to build the message. WDYT? >>>> >>>> On Tue, Sep 15, 2015 at 9:13 PM, Viraj Senevirathne <[email protected]> >>>> wrote: >>>> >>>>> Hi Kalyani, >>>>> >>>>> It would be very useful if you can pay special attention to large file >>>>> transfer mechanisms. In existing vfs transport there are some problems >>>>> encountered when transferring large files. I think it would be great if we >>>>> can implement steaming support for large files as it will improve the >>>>> memory usage of ESB while transferring the file. >>>>> >>>>> Thank you, >>>>> >>>>> On Tue, Sep 15, 2015 at 8:43 PM, Malaka Silva <[email protected]> wrote: >>>>> >>>>>> Hi Kalyani, >>>>>> >>>>>> Also append file is a useful function. Can you provide some details >>>>>> how are you planning to implement VFS listener using NIO? >>>>>> >>>>>> On Tue, Sep 15, 2015 at 3:32 PM, Kalyani Yogeswaranathan < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi All, >>>>>>> >>>>>>> I am going to implement *Local File Inbound*/*Connector* to improve >>>>>>> *local >>>>>>> file processing*. So I have planned to implement polling inbound >>>>>>> and connector using *java.nio* with basic operations such as, >>>>>>> >>>>>>> - Copy >>>>>>> - Delete >>>>>>> - Move >>>>>>> - Read >>>>>>> - Rename >>>>>>> >>>>>>> Can you give some suggestion or guidance on this? >>>>>>> >>>>>>> Thank you. >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> *Kalyani Yogeswaranathan* >>>>>>> >>>>>>> *Associate software engineer* >>>>>>> *WSO2 Inc.* >>>>>>> >>>>>>> *Mobile: 0776390284 <0776390284>* >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Best Regards, >>>>>> >>>>>> Malaka Silva >>>>>> Senior Tech Lead >>>>>> M: +94 777 219 791 >>>>>> Tel : 94 11 214 5345 >>>>>> Fax :94 11 2145300 >>>>>> Skype : malaka.sampath.silva >>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>>>> Blog : http://mrmalakasilva.blogspot.com/ >>>>>> >>>>>> WSO2, Inc. >>>>>> lean . enterprise . middleware >>>>>> http://www.wso2.com/ >>>>>> http://www.wso2.com/about/team/malaka-silva/ >>>>>> <http://wso2.com/about/team/malaka-silva/> >>>>>> >>>>>> Save a tree -Conserve nature & Save the world for your future. Print >>>>>> this email only if it is absolutely necessary. >>>>>> >>>>>> _______________________________________________ >>>>>> Architecture mailing list >>>>>> [email protected] >>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Viraj Senevirathne >>>>> Software Engineer; WSO2, Inc. >>>>> >>>>> Mobile : +94 71 958 0269 >>>>> Email : [email protected] >>>>> >>>>> _______________________________________________ >>>>> Architecture mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> Best Regards, >>>> >>>> Malaka Silva >>>> Senior Tech Lead >>>> M: +94 777 219 791 >>>> Tel : 94 11 214 5345 >>>> Fax :94 11 2145300 >>>> Skype : malaka.sampath.silva >>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>> Blog : http://mrmalakasilva.blogspot.com/ >>>> >>>> WSO2, Inc. >>>> lean . enterprise . middleware >>>> http://www.wso2.com/ >>>> http://www.wso2.com/about/team/malaka-silva/ >>>> <http://wso2.com/about/team/malaka-silva/> >>>> >>>> Save a tree -Conserve nature & Save the world for your future. Print >>>> this email only if it is absolutely necessary. >>>> >>>> _______________________________________________ >>>> Architecture mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>> >>>> >>> >>> >>> -- >>> Viraj Senevirathne >>> Software Engineer; WSO2, Inc. >>> >>> Mobile : +94 71 958 0269 >>> Email : [email protected] >>> >>> _______________________________________________ >>> Architecture mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>> >>> >> >> >> -- >> >> Best Regards, >> >> Malaka Silva >> Senior Tech Lead >> M: +94 777 219 791 >> Tel : 94 11 214 5345 >> Fax :94 11 2145300 >> Skype : malaka.sampath.silva >> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >> Blog : http://mrmalakasilva.blogspot.com/ >> >> WSO2, Inc. >> lean . enterprise . middleware >> http://www.wso2.com/ >> http://www.wso2.com/about/team/malaka-silva/ >> <http://wso2.com/about/team/malaka-silva/> >> >> Save a tree -Conserve nature & Save the world for your future. Print this >> email only if it is absolutely necessary. >> >> _______________________________________________ >> Architecture mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >> >> > > > -- > Viraj Senevirathne > Software Engineer; WSO2, Inc. > > Mobile : +94 71 958 0269 > Email : [email protected] > > _______________________________________________ > Architecture mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture > > -- *Thank you and Regards**Hariprasath Thanarajah* Associate Software Engineer | WSO2 E: [email protected] M: +94752806528
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
