[
https://issues.apache.org/jira/browse/KAFKA-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211215#comment-15211215
]
ASF GitHub Bot commented on KAFKA-3462:
---------------------------------------
GitHub user Ishiihara opened a pull request:
https://github.com/apache/kafka/pull/1139
KAFKA-3462: Allow SinkTasks to disable consumer offset commit
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Ishiihara/kafka disable-offset-commit
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/1139.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1139
----
commit 546877ddbb0acfa079b9322becbb2dbff21c56d7
Author: Liquan Pei <[email protected]>
Date: 2016-03-25T00:29:24Z
Allow SinkTasks to disable consumer offset commit
----
> Allow SinkTasks to disable consumer offset commit
> --------------------------------------------------
>
> Key: KAFKA-3462
> URL: https://issues.apache.org/jira/browse/KAFKA-3462
> Project: Kafka
> Issue Type: Bug
> Components: copycat
> Affects Versions: 0.10.1.0
> Reporter: Liquan Pei
> Assignee: Liquan Pei
> Priority: Minor
> Fix For: 0.10.1.0
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> SinkTasks should be able to disable consumer offset commit if they manage
> offsets in the sink data store rather than using Kafka consumer offsets. For
> example, an HDFS connector might record offsets in HDFS to provide exactly
> once delivery. When the SinkTask is started or a rebalance occurs, the task
> would reload offsets from HDFS. In this case, disabling consumer offset
> commit will save some CPU cycles and network IOs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
