[
https://issues.apache.org/jira/browse/NIFI-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789849#comment-16789849
]
Sandish Kumar HN commented on NIFI-4985:
----------------------------------------
This is what I'mthinkingg,
as Kafka only allows to consume by offset from a single partition/topic at a
time.
We can create a starting_offset property and add a validator to check if the
topic list property contains only a single topic name? only allow this feature
for single topic Kafka processor. what do you think? [~pvillard]
> Allow users to define a specific offset when starting ConsumeKafka
> ------------------------------------------------------------------
>
> Key: NIFI-4985
> URL: https://issues.apache.org/jira/browse/NIFI-4985
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Sandish Kumar HN
> Priority: Major
>
> It'd be useful to add support for dynamic properties in ConsumeKafka set of
> processors so that users can define the offset to use when starting the
> processor. The properties could be something like:
> {noformat}
> kafka.<topic>.<partition>.offset{noformat}
> If, for a configured topic, such a property is not defined for a given
> partition, the consumer would use the auto offset property.
> If a custom offset is defined for a topic/partition, it'd be used when
> initializing the consumer by calling:
> {noformat}
> seek(TopicPartition, long){noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
