[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313130#comment-14313130 ] Guozhang Wang commented on KAFKA-1333: -- Pushed to trunk and leaving this ticket as open for any follow-up items. Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Attachments: KAFKA-1333_2015-01-31_17:40:51.patch, KAFKA-1333_2015-02-06_15:02:48.patch Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310119#comment-14310119 ] Guozhang Wang commented on KAFKA-1333: -- Updated reviewboard https://reviews.apache.org/r/30482/diff/ against branch origin/trunk Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Attachments: KAFKA-1333_2015-01-31_17:40:51.patch, KAFKA-1333_2015-02-06_15:02:48.patch Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300048#comment-14300048 ] Guozhang Wang commented on KAFKA-1333: -- Updated reviewboard https://reviews.apache.org/r/30482/diff/ against branch origin/trunk Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Attachments: KAFKA-1333_2015-01-31_17:40:51.patch Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278905#comment-14278905 ] Onur Karaman commented on KAFKA-1333: - Hey everyone. I spoke with Guozhang about this yesterday. He has started this work. Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278855#comment-14278855 ] Jay Kreps commented on KAFKA-1333: -- Hey [~abiletskyi] A relatively full-fledged Java consumer has been posted with stubs for the new APIs on KAFKA-1760 but none of the server-side work has been started as far as I know... Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278920#comment-14278920 ] Jay Kreps commented on KAFKA-1333: -- Woooh!!! :-) Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279518#comment-14279518 ] Guozhang Wang commented on KAFKA-1333: -- [~abiletskyi] sorry for getting late on this. We are currently making the following progress on KAFKA-1326: 1. I am working on KAFKA-1333, which will define the coordinator module along with its functionality declaration. 2. [~onurkaraman] will work on KAFKA-1334 once it gets unblocked from KAFKA-1333. 3. I am also reviewing KAFKA-1670 for the new client API. At the mean time, you could also take a look at KAFKA-1670 and see if the API definitions fits well for your use case. Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279930#comment-14279930 ] Andrii Biletskyi commented on KAFKA-1333: - [~guozhang] many thanks for such informative update! Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1333) Add consumer co-ordinator module to the server
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278739#comment-14278739 ] Andrii Biletskyi commented on KAFKA-1333: - Hey [~guozhang], We are considering using 0.9 Consumer parts for full-fledged high level Consumer which supports all basic stuff like rebalance etc plus some additional specific to our needs features.Since you are the assignee of this ticket can you please tell where are you on this piece, when there will be some first alpha version patch to review / contribute? Thank you in advance! Add consumer co-ordinator module to the server -- Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-task Components: consumer Affects Versions: 0.9.0 Reporter: Neha Narkhede Assignee: Guozhang Wang Scope of this JIRA is to just add a consumer co-ordinator module that do the following: 1) coordinator start-up, metadata initialization 2) simple join group handling (just updating metadata, no failure detection / rebalancing): this should be sufficient for consumers doing self offset / partition management. Offset manager will still run side-by-side with the coordinator in this JIRA, and we will merge it in KAFKA-1740. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
