[ https://issues.apache.org/jira/browse/CRUNCH-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Micah Whitacre resolved CRUNCH-611. ----------------------------------- Resolution: Fixed Fix Version/s: 0.15.0 Thanks. Pushed changes to master. > Simplified Kafka Offset Management in HDFS > ------------------------------------------ > > Key: CRUNCH-611 > URL: https://issues.apache.org/jira/browse/CRUNCH-611 > Project: Crunch > Issue Type: Improvement > Components: IO > Reporter: Micah Whitacre > Assignee: Micah Whitacre > Fix For: 0.15.0 > > Attachments: CRUNCH-611.patch > > > With the KafkaSource the responsibility of offset management is the burden of > the consumer. With some simple APIs it is actually trivial to support > read/storing these offsets in an HDFS directory as checkpoints for the source. -- This message was sent by Atlassian JIRA (v6.3.4#6332)