Respected Sir, Forgot to mention ,Sometimes I am getting OutOfMemoryError as well
java.lang.OutOfMemoryError: Java heap space Dumping heap to C:/wso2ei-6.1.1/wso2ei-6.1.1/repository/logs/heap-dump.hprof ... Unable to create C:/wso2ei-6.1.1/wso2ei-6.1.1/repository/logs/heap-dump.hprof: File exists [2018-03-14 17:16:01,228] [EI-Core] ERROR - NativeWorkerPool Uncaught exception java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Unknown Source) at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source) at java.lang.AbstractStringBuilder.append(Unknown Source) at java.lang.StringBuffer.append(Unknown Source) at org.apache.log4j.helpers.PatternParser$LiteralPatternConverter.format(PatternParser.java:419) With Regards, Aditya On Wed, Mar 14, 2018 at 4:46 PM, aditya shivankar < [email protected]> wrote: > added the missing attachment from previous mail > > On Wed, Mar 14, 2018 at 4:44 PM, aditya shivankar < > [email protected]> wrote: > >> Respected Sir/Madam, >> >> I am able to achieve below file processing using vfs, and datamapper. But >> when trying to process files more than size of 8 MB or more the flow is >> failing with out of memory. Please guide >> >> step 1. I am using vfs to read one xml file from one location. >> step 2. Then using datamapper to convert the xml file to csv. >> step 3. Then writing the converted output to another location. >> >> >> <?xml version="1.0" encoding="UTF-8"?> >> <proxy name="FlatFileProxy" startOnLoad="true" transports="vfs" xmlns=" >> http://ws.apache.org/ns/synapse";> >> <target> >> <inSequence> >> <log level="custom"> >> <property name="property_name" value=""Inside >> FlatFile ***************************************** ""/> >> </log> >> <property name="FORCE_SC_ACCEPTED" scope="axis2" >> type="STRING" value="true"/> >> <property name="REST_URL_POSTFIX" scope="axis2" type="STRING" >> value=""/> >> <datamapper config="gov:datamapper/xmlToCsv1.dmc" >> inputSchema="gov:datamapper/xmlToCsv1_inputSchema.json" inputType="XML" >> outputSchema="gov:datamapper/xmlToCsv1_outputSchema.json" >> outputType="CSV"/> >> <property expression="fn:concat(fn:subst >> ring-after(get-property('MessageID'), 'urn:uuid:'), '.csv')" >> name="transport.vfs.ReplyFileName" scope="transport" type="STRING"/> >> <property name="OUT_ONLY" scope="default" type="STRING" >> value="true"/> >> <property name="messageType" scope="axis2" type="STRING" >> value="application/csv"/> >> <property action="remove" name="LAST_MODIFIED" >> scope="transport"/> >> <send> >> <endpoint> >> <address uri="vfs:file:///C:/Flatfile/output"/> >> </endpoint> >> </send> >> </inSequence> >> <outSequence/> >> <faultSequence/> >> </target> >> <parameter name="transport.PollInterval">50ms</parameter> >> <parameter name="transport.vfs.FileURI">f >> ile:///C:/Flatfile/input</parameter> >> <parameter name="transport.vfs.ContentTyp >> e">application/xml</parameter> >> <parameter name="transport.vfs.ActionAfterProcess">MOVE</parameter> >> <parameter name="transport.vfs.MoveAfterFailure">file:///C:/Flatfile/ >> failure</parameter> >> <parameter name="transport.vfs.ActionAfterFailure">MOVE</parameter> >> <parameter name="transport.vfs.FileNamePattern">.*\.xml</parameter> >> <parameter name="transport.vfs.Locking">disable</parameter> >> <parameter name="transport.vfs.MoveAfterP >> rocess">file:///C:/Flatfile/orgFilesProcessedSuccessfully</parameter> >> </proxy> >> >> >> sometimes it is not able to delete .lock files from input folder. >> sometimes timeout error. >> >> etc.. >> >> Sample input attached. >> >> With regards, >> Aditya >> > >
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
