[
https://issues.apache.org/jira/browse/NIFI-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290940#comment-15290940
]
ASF subversion and git services commented on NIFI-1837:
-------------------------------------------------------
Commit 2d03489ec5dbc56bcb0dbd7b694cdf030d2532a5 in nifi's branch
refs/heads/master from [~ozhurakousky]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=2d03489 ]
NIFI-1296, NIFI-1680, NIFI-1764, NIFI-1837, NIFI-1827, NIFI-1699 implemented
new Kafka processors that leverage Kafka 0.9 API
- Improved StreamScanner for better performance
- Renamed StreamScanner to StreamDemarcator as suggested by Joe
- Added failure handling logic to ensure both processors can be reset to their
initial state (as if they were just started)
- Provided comprehensive test suite to validate various aspects of both Publish
and Consume from Kafka
- Added relevant javadocs
- Added initial additionalDetails docs
- Addressed NPE reported by NIFI-1764
- Life-cycle refactoring for the existing PutKafka to ensure producer restart
after errors
- Incorporated code changes contributed by Ralph Perko (see NIFI-1837)
- Addressed partition issue in RoundRobinPartitioner discussed in NIFI-1827
- Updated PropertyDescriptor descriptions to reflect their purpose
NIFI-1296 added @Ignore on some Kafka tests to improve test time
NIFI-1296 reworked tests to avoid dependency on embedded Kafka
NIFI-1296 fixed spelling error
NIFI-1296 fixed trailing whitespaces in non-java files
This closes #366
> PutKafka - Decouple incoming message delimiter from outgoing batching
> ---------------------------------------------------------------------
>
> Key: NIFI-1837
> URL: https://issues.apache.org/jira/browse/NIFI-1837
> Project: Apache NiFi
> Issue Type: Improvement
> Affects Versions: 0.6.1
> Reporter: Ralph Perko
> Assignee: Oleg Zhurakousky
> Labels: kafka
> Fix For: 1.0.0, 0.7.0
>
> Attachments: NIFI-1837.diff
>
>
> In 0.6.x batching outgoing messages to Kafka is only supported if a message
> delimiter is provided for incoming flow files. This appears to be a recently
> added constraint. It did not exist in 0.4.x. Could you please remove this.
> PutKafka.java:453
> Remove the "if" statement and just have:
> properties.setProperty("batch.size",
> context.getProperty(BATCH_NUM_MESSAGES).getValue());
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
