[
https://issues.apache.org/jira/browse/CAMEL-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409279#comment-17409279
]
Tapio Piironen commented on CAMEL-16916:
----------------------------------------
Thank you for the hint about streaming mode. Thought only the original split
was in memory but if all the files are too, then it will fill memory for
certain.
In camel version 3.4.3 everything worked. This started happening after 3.11.0 .
Will try to investigate JVM and reporting my findings here.
> camel split with parallel processing true consumes lots of heap space
> ---------------------------------------------------------------------
>
> Key: CAMEL-16916
> URL: https://issues.apache.org/jira/browse/CAMEL-16916
> Project: Camel
> Issue Type: Bug
> Components: camel-core
> Affects Versions: 3.11.1
> Environment: RHEL Linux 7
> Karaf 3.2.1
> OpenJDK 11
> Reporter: Tapio Piironen
> Priority: Major
>
> Camel split with parallel processing true consumes lots of heap space and
> eventually (after several huge runs) makes java run out of heap space.
> Reading 50 000 lines from source and creating 50 000 responses as xml files.
> Out of heap space happends after 3-4 runs (once a day). Workaround is to make
> parallelProcessing to false .
> My route:
> <from uri="sftp://server?fileName=list.txt"/>
> <split parallelProcessing="true">
> <tokenize token="\r\n|\n" xml="false" trim="true"/>
> <convertBodyTo type="java.lang.String" charset="UTF-8"/>
> <to uri="bean:collectDataByBody?method=collect"/>
> <to uri="direct:sendToSftp"/>
> </split>
> <from uri="direct:sendToSftp"/>
> <choice>
> <when>
> <simple>${body} != null</simple>
> <marshal>
> <jaxb contextPath="fi.package.entity"/>
> </marshal>
> <to uri="sftp://server/answers?disconnect=true"/>
> </when>
> <otherwise></otherwise>
> </choice>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
