Hi Amit, Have you tried the streaming with inbound endpoints?
Also please send your queries to [email protected]. You can cc me. That way more people from community can help you. :) [1] http://mrmalakasilva.blogspot.com/2016/03/streaming-large-files-using-wso2-esb.html [2] https://docs.wso2.com/display/ESB500/Tuning+the+VFS+Transport [3] https://docs.wso2.com/display/ESB500/File+Inbound+Protocol ---------- Forwarded message ---------- From: Amit Rajvanshi <[email protected]> Date: Tue, Jan 10, 2017 at 7:05 PM Subject: Help required To: Malaka Silva <[email protected]> Hi Malaka, We again need your help : We are trying to process one xml which contains around 60000 instance of an object and the size of XML is 140 MB. We are receiving this file through Inbound endpoint file location and doing some changes in custom mediator java code using DOM object. While we are processing small files around 30 MB it get processed successfully but for large files it is giving out of memory error: java.lang.OutOfMemoryError: Java heap space if we set our JVM to *-Xms2048m -Xmx2048m -XX:MaxPermSize=1024m* which is suggested by WSO2 it is giving error and if we set it to *-Xms1024m -Xmx4096m -XX:MaxPermSize=2048m* then it is working fine while if we process same file in java code then it is working fine with less memory as well. While debugging we have also found that it is increasing heap memory when we are taking xml object from context. This scenario is also reproducible for iterate mediator . Could you please help us or suggest if there are any memory tuning required for xml at message context level or somewhere else. Best regards, *Amit Rajvanshi* Eperium Business Solutions (I) Pvt Ltd, B-13, Sector 57, Noida (U.P.) - 201301 Phone: +91-120-4737401 <+91%20120%20473%207401> Web: www.eperiumindia.com *Shaping future commerce together* This message may contain confidential or legally privileged information. In the event of any error in transmission, unauthorized recipients are requested to contact the sender immediately and not to disclose or make use of this information. No warranties or assurance are made or given as to the accuracy of the information given or in relation to the safety of this e-mail and any attachments. No liability whatsoever is accepted for any consequences arising from this e-mail. -- Best Regards, Malaka Silva Senior Technical Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware https://wso2.com/signature http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> https://store.wso2.com/store/ Don't make Trees rare, we should keep them with care
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
