[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[Matthias J. Sax (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046851#comment-16046851
 ] 

Matthias J. Sax commented on KAFKA-4743:


Thanks a lot. Sounds great :)

> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[Jorge Quilcate (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046071#comment-16046071
 ] 

Jorge Quilcate commented on KAFKA-4743:
---

I was about to ask you about the same :) I'd be keen to introduce this for 
Streams applications. 
Let me first take a look into `kafka-streams-application-reset` implementation 
and get back to you to work on the KIP. 

> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[Matthias J. Sax (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044620#comment-16044620
 ] 

Matthias J. Sax commented on KAFKA-4743:


[~jeqo] As this is done, are you interested to extend 
`bin/kafka-streams-application-reset.sh` with a similar feature? Would require 
a KIP, too (there is also no JIRA yet). The "problem" right now is, that user 
need to use two tools to reset an Streams application and set an arbitrary 
start offset. Would be nice if a single tool could do this :)

> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014804#comment-16014804
 ] 

ASF GitHub Bot commented on KAFKA-4743:
---

Github user asfgit closed the pull request at:

https://github.com/apache/kafka/pull/2624


> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[Jorge Quilcate (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003394#comment-16003394
 ] 

Jorge Quilcate commented on KAFKA-4743:
---

Hi [~guozhang], I'm using the current operations from Consumer API to seek 
offsets by position and time, and commit new offsets. 
Do you have an idea on how this new request protocol could look like and how it 
will simplify the current implementation?

> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[Guozhang Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998851#comment-15998851
 ] 

Guozhang Wang commented on KAFKA-4743:
--

Created 5181 without being aware of this ticket. I think if we can add a new 
request protocol to the admin client then this tool could be largely 
simplified: create an admin client and call its apis.

> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>Assignee: Jorge Quilcate
>  Labels: kip
> Fix For: 0.11.0.0
>
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890839#comment-15890839
 ] 

ASF GitHub Bot commented on KAFKA-4743:
---

GitHub user jeqo opened a pull request:

https://github.com/apache/kafka/pull/2624

KAFKA-4743: Add Reset Consumer Group Offsets tooling [KIP-122]



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jeqo/kafka 
feature/rewind-consumer-group-offset

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/2624.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2624


commit ef14ccfc99360a389bf6597a7eb92cf8a1076c69
Author: Jorge Quilcate 
Date:   2017-02-17T15:20:59Z

Add reset-offset option

commit 25b3e758f32375431b56e0d810d7e66a154f8d78
Author: Jorge Quilcate 
Date:   2017-02-17T15:58:18Z

Add reset-offset print assignments

commit 398bd76580d4c937430a2c5fbee0e27659acc5da
Author: Jorge Quilcate 
Date:   2017-02-20T02:28:12Z

Draft Reset to specific commit

commit 3aa04620600b71c1d4fc6c6bf37f8cfd95bc6974
Author: Jorge Quilcate 
Date:   2017-02-20T11:48:29Z

Add plus, minus, earliest, latest cases

commit 01a65569046bba6f2425cb4429484afbcd548f2d
Author: Jorge Quilcate 
Date:   2017-02-20T16:17:22Z

change period by duration

commit 43fef5a88956fca084b8c43912be145215468daa
Author: Jorge Quilcate 
Date:   2017-02-20T22:07:17Z

add export/import reset plan

commit 308b2b7623169427c926cf61d77ec3dba1f2626a
Author: Jorge Quilcate 
Date:   2017-02-20T22:10:50Z

fix print

commit 34376f18078092584028b9c704a07b28c3d41143
Author: Jorge Quilcate 
Date:   2017-02-21T10:45:59Z

rename options, change json to csv format

commit bafc4e0ebd7e0673e638f39e39a7666735687420
Author: Jorge Quilcate 
Date:   2017-02-21T11:32:28Z

fix csv generation

commit d1b4588ac4f497a4e3605ad429dc17dd41535468
Author: Jorge Quilcate 
Date:   2017-03-01T17:50:06Z

add test cases

commit 93badea267b91d33c0ddbba64847dd53ca580f47
Author: Jorge Quilcate 
Date:   2017-03-01T18:23:04Z

add test cases for duration and datetime

commit 0af432fec9e800f2c207b81b71927b7ec73a7edf
Author: Jorge Quilcate 
Date:   2017-03-01T18:55:44Z

add test case for export import

commit 8178a4a8612cd86d5516cde9f0f61d5df9971dfb
Author: Jorge Quilcate 
Date:   2017-03-01T19:05:15Z

fix messages




> Add a tool to Reset Consumer Group Offsets
> --
>
> Key: KAFKA-4743
> URL: https://issues.apache.org/jira/browse/KAFKA-4743
> Project: Kafka
>  Issue Type: New Feature
>  Components: consumer, core, tools
>Reporter: Jorge Quilcate
>  Labels: kip
>
> Add an external tool to reset Consumer Group offsets, and achieve rewind over 
> the topics, without changing client-side code.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)