Hi,

As the summary of my results of file connector (file send), herewith I have
attached graph which is specifying heap memory usage when streaming in
default VFS sender in ESB and using File connector.


​Thanks.
​

Best Regards,
Yashothara.S

Software Engineer
WSO2


On Wed, May 18, 2016 at 9:25 AM, Yashothara Shanmugarajah <
[email protected]> wrote:

> Yep Malaka. I have implemented this feature.
>
> Best Regards,
> Yashothara.S
>
> Software Engineer
> WSO2
>
>
> On Wed, May 18, 2016 at 9:24 AM, Malaka Silva <[email protected]> wrote:
>
>> Hi Yashothara,
>>
>> Have we implemented this feature?
>>
>> On Wed, May 4, 2016 at 12:54 PM, Yashothara Shanmugarajah <
>> [email protected]> wrote:
>>
>>> Hi all,
>>>
>>> I have herewith attached the link [1] to my milestone plan for the File
>>> Connector project. Please be kind enough to provide necessary feedback, at
>>> your convenience.
>>>
>>> Please let me know if there's anything else that I should work on or
>>> that you think I missed.
>>>
>>> [1]
>>> https://docs.google.com/spreadsheets/d/15AZGjb4IvdGizUlybLIyD9hHKvWLstyqGm8_f1ocdBI/edit#gid=0
>>>
>>> Best Regards,
>>> Yashothara.S
>>>
>>> Software Engineer
>>> WSO2
>>>
>>>
>>> On Wed, May 4, 2016 at 8:05 AM, Yashothara Shanmugarajah <
>>> [email protected]> wrote:
>>>
>>>> Current File connector V2 doesn't have feature for VFS sender. I will
>>>> share the milestone.
>>>>
>>>> Best Regards,
>>>> Yashothara.S
>>>>
>>>> Software Engineer
>>>> WSO2
>>>>
>>>>
>>>> On Wed, May 4, 2016 at 8:00 AM, Malaka Silva <[email protected]> wrote:
>>>>
>>>>> Can you share a milestone plan please.
>>>>>
>>>>> Also my understanding is current requirement is not covered with file
>>>>> connector v2?
>>>>>
>>>>> On Wed, May 4, 2016 at 7:57 AM, Yashothara Shanmugarajah <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I have started to implement new method for doing the VFS sender
>>>>>> feature in file connector. Try to finish as soon as possible.
>>>>>>
>>>>>> Best Regards,
>>>>>> Yashothara.S
>>>>>>
>>>>>> Software Engineer
>>>>>> WSO2
>>>>>>
>>>>>>
>>>>>> On Wed, May 4, 2016 at 7:51 AM, Malaka Silva <[email protected]> wrote:
>>>>>>
>>>>>>> Hi Yashothara,
>>>>>>>
>>>>>>> What is the update. how are you proceeding with the feature?
>>>>>>>
>>>>>>> On Mon, Apr 25, 2016 at 8:29 AM, Yashothara Shanmugarajah <
>>>>>>> [email protected]> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> As the summary of my results of file connector (file move),
>>>>>>>> herewith I have attached two graphs which is specifying heap memory 
>>>>>>>> usage
>>>>>>>> when streaming in default VFS sender in ESB and using File connector.
>>>>>>>>
>>>>>>>> Best Regards,
>>>>>>>> Yashothara.S
>>>>>>>>
>>>>>>>> Software Engineer
>>>>>>>> WSO2
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Apr 25, 2016 at 6:23 AM, Malaka Silva <[email protected]>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Yashothara the idea should be if this (VFS sender) is currently
>>>>>>>>> not supported with file connector, incorporate the functionality to 
>>>>>>>>> the
>>>>>>>>> connector.
>>>>>>>>>
>>>>>>>>> On Sun, Apr 24, 2016 at 6:04 PM, Yashothara Shanmugarajah <
>>>>>>>>> [email protected]> wrote:
>>>>>>>>>
>>>>>>>>>> This was default vfs sender. But I have used file connector as
>>>>>>>>>> the sender and I got snapshots for that. I will update the graph for 
>>>>>>>>>> file
>>>>>>>>>> connector soon.
>>>>>>>>>>
>>>>>>>>>> Thank you.
>>>>>>>>>>
>>>>>>>>>> Best Regards,
>>>>>>>>>> Yashothara.S
>>>>>>>>>>
>>>>>>>>>> Software Engineer
>>>>>>>>>> WSO2
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sun, Apr 24, 2016 at 8:03 AM, Malaka Silva <[email protected]>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Did you use fileconnector as the sender? or default vfs sender?
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Apr 22, 2016 at 1:43 PM, Yashothara Shanmugarajah <
>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>>
>>>>>>>>>>>> As the summary of my results herewith I have attached two
>>>>>>>>>>>> graphs which is specifying heap memory usage when streaming and not
>>>>>>>>>>>> streaming.
>>>>>>>>>>>>
>>>>>>>>>>>> Best Regards,
>>>>>>>>>>>> Yashothara.S
>>>>>>>>>>>>
>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>> WSO2
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Apr 19, 2016 at 12:16 PM, Yashothara Shanmugarajah <
>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi all,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I am testing VFS sender in ESB using different set of files
>>>>>>>>>>>>> with different sizes (10MB to 5 GB which include zip file and txt 
>>>>>>>>>>>>> files) by
>>>>>>>>>>>>> putting streaming as true and false. When streaming is false and 
>>>>>>>>>>>>> normal
>>>>>>>>>>>>> configuration (*-Xms256m -Xmx512m -XX:MaxPermSize=256m)* for
>>>>>>>>>>>>> ESB heap memory allocation until 250MB file was worked fine. 
>>>>>>>>>>>>> After that it
>>>>>>>>>>>>> gave out of memory issue. Then after changing the configuration 
>>>>>>>>>>>>> to heap
>>>>>>>>>>>>> memory allocation (*-Xms2048m -Xmx2048m -XX:MaxPermSize=1024m*)
>>>>>>>>>>>>> until 1 GB zip file it worked fine. But 1 GB txt file got out of 
>>>>>>>>>>>>> memory
>>>>>>>>>>>>> issue.
>>>>>>>>>>>>>
>>>>>>>>>>>>> But when streaming is true until 5 GB it worked fine. I
>>>>>>>>>>>>> checked all these scenarios with jconsole and got snapshot in 
>>>>>>>>>>>>> that period.
>>>>>>>>>>>>> When streaming is true i got 500MB heap memory usage for 5 GB 
>>>>>>>>>>>>> data. But
>>>>>>>>>>>>> around 1 GB memory space is used when I test 1 Gb file without 
>>>>>>>>>>>>> Streaming.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Herewith I have attached snapshots of jconsole.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best Regards,
>>>>>>>>>>>>> Yashothara.S
>>>>>>>>>>>>>
>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>> WSO2
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>> Best Regards,
>>>>>>>>>>>
>>>>>>>>>>> Malaka Silva
>>>>>>>>>>> Senior Tech Lead
>>>>>>>>>>> M: +94 777 219 791
>>>>>>>>>>> Tel : 94 11 214 5345
>>>>>>>>>>> Fax :94 11 2145300
>>>>>>>>>>> Skype : malaka.sampath.silva
>>>>>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>>>>>>>>>>> Blog : http://mrmalakasilva.blogspot.com/
>>>>>>>>>>>
>>>>>>>>>>> WSO2, Inc.
>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>> http://www.wso2.com/
>>>>>>>>>>> http://www.wso2.com/about/team/malaka-silva/
>>>>>>>>>>> <http://wso2.com/about/team/malaka-silva/>
>>>>>>>>>>> https://store.wso2.com/store/
>>>>>>>>>>>
>>>>>>>>>>> Save a tree -Conserve nature & Save the world for your future.
>>>>>>>>>>> Print this email only if it is absolutely necessary.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> Best Regards,
>>>>>>>>>
>>>>>>>>> Malaka Silva
>>>>>>>>> Senior Tech Lead
>>>>>>>>> M: +94 777 219 791
>>>>>>>>> Tel : 94 11 214 5345
>>>>>>>>> Fax :94 11 2145300
>>>>>>>>> Skype : malaka.sampath.silva
>>>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>>>>>>>>> Blog : http://mrmalakasilva.blogspot.com/
>>>>>>>>>
>>>>>>>>> WSO2, Inc.
>>>>>>>>> lean . enterprise . middleware
>>>>>>>>> http://www.wso2.com/
>>>>>>>>> http://www.wso2.com/about/team/malaka-silva/
>>>>>>>>> <http://wso2.com/about/team/malaka-silva/>
>>>>>>>>> https://store.wso2.com/store/
>>>>>>>>>
>>>>>>>>> Save a tree -Conserve nature & Save the world for your future.
>>>>>>>>> Print this email only if it is absolutely necessary.
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Best Regards,
>>>>>>>
>>>>>>> Malaka Silva
>>>>>>> Senior Tech Lead
>>>>>>> M: +94 777 219 791
>>>>>>> Tel : 94 11 214 5345
>>>>>>> Fax :94 11 2145300
>>>>>>> Skype : malaka.sampath.silva
>>>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>>>>>>> Blog : http://mrmalakasilva.blogspot.com/
>>>>>>>
>>>>>>> WSO2, Inc.
>>>>>>> lean . enterprise . middleware
>>>>>>> http://www.wso2.com/
>>>>>>> http://www.wso2.com/about/team/malaka-silva/
>>>>>>> <http://wso2.com/about/team/malaka-silva/>
>>>>>>> https://store.wso2.com/store/
>>>>>>>
>>>>>>> Save a tree -Conserve nature & Save the world for your future. Print
>>>>>>> this email only if it is absolutely necessary.
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Best Regards,
>>>>>
>>>>> Malaka Silva
>>>>> Senior Tech Lead
>>>>> M: +94 777 219 791
>>>>> Tel : 94 11 214 5345
>>>>> Fax :94 11 2145300
>>>>> Skype : malaka.sampath.silva
>>>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>>>>> Blog : http://mrmalakasilva.blogspot.com/
>>>>>
>>>>> WSO2, Inc.
>>>>> lean . enterprise . middleware
>>>>> http://www.wso2.com/
>>>>> http://www.wso2.com/about/team/malaka-silva/
>>>>> <http://wso2.com/about/team/malaka-silva/>
>>>>> https://store.wso2.com/store/
>>>>>
>>>>> Save a tree -Conserve nature & Save the world for your future. Print
>>>>> this email only if it is absolutely necessary.
>>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Best Regards,
>>
>> Malaka Silva
>> Senior Tech Lead
>> M: +94 777 219 791
>> Tel : 94 11 214 5345
>> Fax :94 11 2145300
>> Skype : malaka.sampath.silva
>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>> Blog : http://mrmalakasilva.blogspot.com/
>>
>> WSO2, Inc.
>> lean . enterprise . middleware
>> http://www.wso2.com/
>> http://www.wso2.com/about/team/malaka-silva/
>> <http://wso2.com/about/team/malaka-silva/>
>> https://store.wso2.com/store/
>>
>> Save a tree -Conserve nature & Save the world for your future. Print this
>> email only if it is absolutely necessary.
>>
>
>
_______________________________________________
Architecture mailing list
[email protected]
https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture

Reply via email to