[
https://issues.apache.org/jira/browse/SAMZA-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664633#comment-15664633
]
Navina Ramesh commented on SAMZA-1042:
--------------------------------------
Merged and committed.
It will be useful to add documentation for this feature/change in contract for
SystemConsumer. I will create a JIRA and assign it to you :)
> Allow offset notifications for input systems
> --------------------------------------------
>
> Key: SAMZA-1042
> URL: https://issues.apache.org/jira/browse/SAMZA-1042
> Project: Samza
> Issue Type: Bug
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: NotifiableConsumer.md, NotifiableConsumer.pdf,
> SAMZA-1042-0.patch, notifiable consumer2.md, notifiable-consumer2.pdf,
> rb53453.patch
>
>
> Currently we keep track of the progress of each consumer using checkpointing
> mechanism. These checkpoints are controlled by Samza, and the system consumer
> is not aware of it.
> But some systems may require knowledge of the current checkpointed position
> in the stream.
> For this purpose we propose an optional notification mechanism for input
> systems.
> See the attached doc for details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)