Can you please post your current JVM arguments?
On Tue, Mar 3, 2009 at 10:24 PM, kimhorn <[email protected]> wrote: > > I am being FTped a large EDI (text) file but heap runs out. See below. > In what batch script / file / wrapper / parameter do I specify new heap > size in ? > Yes I know how to set it for Java.... > > VFS runs out at about 15MB file. Unfortunately we will be getting 100 MB > files !!!! > Want to break these up and submit in smaller chunks to a web service. > > Has anyone used Synapse to process large files. I am wondering if Synapse is > just the wrong solution. > May use our SFTP server, as is, and then use UNIX script to split file. Use > these to trigger a synapse VFS file proxy to submit. > > Otherwise; for large EDI files a VFS iterator Mediator that streams through > input file and outputs smaller > chunks for processing, in Synapse, may be a solution ? > > If the payload was zipped has anyone thought of how to process the file once > in synapse. At the > moment the file doesn't even get into Synapse. If its zipped, then it may > get in, but what then ? > > See prior item : "Large Payload: Issues" for background. > > > 2009-03-04 16:57:11,006 [-] [vfs-Worker-1] DEBUG VFSTransportListener > Scanning directory or file : file:///C:/test/in > 2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener File > name pattern :.*\.edi > 2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener > Matching file :270-Valid-320000-Checks.edi > 2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener > Processing file :file:///C:/test/in/270-Valid-320000-Checks.e > Exception in thread "vfs-Worker-1" java.lang.OutOfMemoryError: Java heap > space > at > java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:99) > at > java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:518) > at java.lang.StringBuffer.append(StringBuffer.java:307) > at java.io.StringWriter.write(StringWriter.java:72) > at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1129) > at org.apache.commons.io.IOUtils.copy(IOUtils.java:1104) > at org.apache.commons.io.IOUtils.copy(IOUtils.java:1078) > at org.apache.commons.io.IOUtils.toString(IOUtils.java:382) > at > org.apache.synapse.format.PlainTextBuilder.processDocument(PlainTextBuilder.java:68) > at > org.apache.axis2.transport.TransportUtils.createDocumentElement(TransportUtils.java:164) > at > org.apache.axis2.transport.TransportUtils.createSOAPMessage(TransportUtils.java:112) > at > org.apache.synapse.transport.vfs.VFSTransportListener.processFile(VFSTransportListener.java:433) > at > org.apache.synapse.transport.vfs.VFSTransportListener.scanFileOrDirectory(VFSTransportListener.java:241) > at > org.apache.synapse.transport.vfs.VFSTransportListener.onPoll(VFSTransportListener.java:145) > at > org.apache.synapse.transport.base.AbstractPollingTransportListener$1$1.run(AbstractPollingTransportListener.java:94) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) > at java.lang.Thread.run(Thread.java:595) > -- > View this message in context: > http://www.nabble.com/java.lang.OutOfMemoryError---Where-do-U-increase-heap-space.-tp22324403p22324403.html > Sent from the Synapse - User mailing list archive at Nabble.com. > >
