Jay Kreps created KAFKA-657:
-------------------------------
Summary: Add an API to commit offsets
Key: KAFKA-657
URL: https://issues.apache.org/jira/browse/KAFKA-657
Project: Kafka
Issue Type: New Feature
Reporter: Jay Kreps
Currently the consumer directly writes their offsets to zookeeper. Two problems
with this: (1) This is a poor use of zookeeper, and we need to replace it with
a more scalable offset store, and (2) it makes it hard to carry over to clients
in other languages. A first step towards accomplishing that is to add a proper
Kafka API for committing offsets. The initial version of this would just write
to zookeeper as we do today, but in the future we would then have the option of
changing this.
This api likely needs to take a sequence of
consumer-group/topic/partition/offset entries and commit them all.
It would be good to do a wiki design on how this would work and consensus on
that first.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira