[
https://issues.apache.org/jira/browse/NIFI-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368210#comment-15368210
]
ASF GitHub Bot commented on NIFI-2192:
--------------------------------------
Github user markap14 commented on a diff in the pull request:
https://github.com/apache/nifi/pull/618#discussion_r70125032
--- Diff:
nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-pubsub-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/KafkaPublisher.java
---
@@ -100,15 +107,31 @@ KafkaPublisherResult publish(PublishingContext
publishingContext) {
byte[] messageBytes;
int tokenCounter = 0;
- for (; (messageBytes = streamTokenizer.nextToken()) != null;
tokenCounter++) {
+ boolean continueSending = true;
+ KafkaPublisherResult result = null;
+ for (; (messageBytes = streamTokenizer.nextToken()) != null &&
continueSending; tokenCounter++) {
--- End diff --
Would recommend switching the orders of the conditions here, as mentioned
above.
> PutKafka results in OOME if sending very large delimited file
> -------------------------------------------------------------
>
> Key: NIFI-2192
> URL: https://issues.apache.org/jira/browse/NIFI-2192
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 0.7.0
> Reporter: Mark Payne
> Assignee: Oleg Zhurakousky
> Priority: Blocker
> Fix For: 1.0.0, 0.7.0
>
>
> If I send a very large file to kafka via PutKafka using a delimiter, I see
> the Java heap fill up until we see constant Full Garbage Collections and the
> node eventually dies.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
