[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[
https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586472#comment-16586472
]
ASF GitHub Bot commented on KAFKA-6312:
---
hachikuji closed pull request #4527: KAFKA-6312 Add documentation about
kafka-consumer-groups.sh's ability…
URL: https://github.com/apache/kafka/pull/4527
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/docs/ops.html b/docs/ops.html
index 95b9a960172..6fe8fffeba2 100644
--- a/docs/ops.html
+++ b/docs/ops.html
@@ -229,6 +229,69 @@ Managing C
Deletion of requested consumer groups ('my-group', 'my-other-group') was
successful.
+
+ To reset offsets of a consumer group, "--reset-offsets" option can be used.
+ This option supports one consumer group at the time. It requires defining
following scopes: --all-topics or --topic. One scope must be selected, unless
you use '--from-file' scenario. Also, first make sure that the consumer
instances are inactive.
+ See https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling;>KIP-122
for more details.
+
+
+ It has 3 execution options:
+
+
+ (default) to display which offsets to reset.
+
+
+ --execute : to execute --reset-offsets process.
+
+
+ --export : to export the results to a CSV format.
+
+
+
+
+ --reset-offsets also has following scenarios to choose from (atleast one
scenario must be selected):
+
+
+ --to-datetime String: datetime : Reset offsets to offsets from
datetime. Format: '-MM-DDTHH:mm:SS.sss'
+
+
+ --to-earliest : Reset offsets to earliest offset.
+
+
+ --to-latest : Reset offsets to latest offset.
+
+
+ --shift-by Long: number-of-offsets : Reset offsets shifting
current offset by 'n', where 'n' can be positive or negative.
+
+
+ --from-file : Reset offsets to values defined in CSV file.
+
+
+ --to-current : Resets offsets to current offset.
+
+
+ --by-duration String: duration : Reset offsets to offset by
duration from current timestamp. Format: 'PnDTnHnMnS'
+
+
+ --to-offset : Reset offsets to a specific offset.
+
+
+
+ Please note, that out of range offsets will be adjusted to available offset
end. For example, if offset end is at 10 and offset shift request is
+ of 15, then, offset at 10 will actually be selected.
+
+
+ For example, to reset offsets of a consumer group to the latest offset:
+
+
+ bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092
--reset-offsets --group consumergroup1 --topic topic1 --to-latest
+
+ TOPIC PARTITION NEW-OFFSET
+ topic1 0 0
+
+
+
+
If you are using the old high-level consumer and storing the group metadata
in ZooKeeper (i.e. offsets.storage=zookeeper), pass
--zookeeper instead of bootstrap-server:
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Add documentation about kafka-consumer-groups.sh's ability to set/change
> offsets
>
>
> Key: KAFKA-6312
> URL: https://issues.apache.org/jira/browse/KAFKA-6312
> Project: Kafka
> Issue Type: Improvement
> Components: documentation
>Reporter: James Cheng
>Assignee: Mayank Tankhiwale
>Priority: Major
> Labels: newbie
>
> KIP-122 added the ability for kafka-consumer-groups.sh to reset/change
> consumer offsets, at a fine grained level.
> There is documentation on it in the kafka-consumer-groups.sh usage text.
> There is no such documentation on the kafka.apache.org website. We should add
> some documentation to the website, so that users can read about the
> functionality without having the tools installed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352573#comment-16352573 ] ASF GitHub Bot commented on KAFKA-6312: --- tankhiwale opened a new pull request #4527: KAFKA-6312 Add documentation about kafka-consumer-groups.sh's ability… URL: https://github.com/apache/kafka/pull/4527 … to set/change offsets KIP-122 added the ability for kafka-consumer-groups.sh to reset/change consumer offsets, at a fine grained level. There is documentation on it in the kafka-consumer-groups.sh usage text. There is no such documentation on the kafka.apache.org website. We should add some documentation to the website, so that users can read about the functionality without having the tools installed. *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing strategy (including rationale) for the feature or bug fix. Unit and/or integration tests are expected for any behaviour change and system tests should be considered for larger changes.* ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes) This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Assignee: Mayank Tankhiwale >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352551#comment-16352551 ] ASF GitHub Bot commented on KAFKA-6312: --- tankhiwale closed pull request #4496: KAFKA-6312: Update website documentation for --reset-offsets option, … URL: https://github.com/apache/kafka/pull/4496 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Assignee: Mayank Tankhiwale >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347005#comment-16347005 ] ASF GitHub Bot commented on KAFKA-6312: --- tankhiwale opened a new pull request #4496: KAFKA-6312: Update website documentation for --reset-offsets option, … URL: https://github.com/apache/kafka/pull/4496 …for Kafka consumer groups, introduced in KIP-122 KIP-122 added the ability for kafka-consumer-groups.sh to reset/change consumer offsets, at a fine grained level. There is documentation on it in the kafka-consumer-groups.sh usage text. There was no such documentation on the kafka.apache.org website. This change updates the documentation on the website, so that users can read about the functionality without having the tools installed. @omkreddy , @guozhangwang , @ijuma kindly review this PR. This is my first first contribution to any project ever. Please let me know if I have missed something. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Assignee: Mayank Tankhiwale >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346938#comment-16346938 ] ASF GitHub Bot commented on KAFKA-6312: --- tankhiwale closed pull request #123: KAFKA-6312: Update website documentation for --reset-offsets option, … URL: https://github.com/apache/kafka-site/pull/123 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/10/ops.html b/10/ops.html index 92077df..59d7e17 100644 --- a/10/ops.html +++ b/10/ops.html @@ -183,6 +183,15 @@ Managing C test-foo 0 1 3 2 consumer-1-a5d61779-4d04-4c50-a6d6-fb35d942642d /127.0.0.1 consumer-1 + To reset offsets of a consumer group to latest offset, first make sure the instances are inactive, then: + + + bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --reset-offsets --group consumergroup1 --topic topic1 --to-latest + + TOPIC PARTITION NEW-OFFSET + topic1 0 0 + + If you are using the old high-level consumer and storing the group metadata in ZooKeeper (i.e. offsets.storage=zookeeper), pass --zookeeper instead of bootstrap-server: This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Assignee: Mayank Tankhiwale >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346889#comment-16346889 ] ASF GitHub Bot commented on KAFKA-6312: --- tankhiwale opened a new pull request #123: KAFKA-6312: Update website documentation for --reset-offsets option, … URL: https://github.com/apache/kafka-site/pull/123 …for Kafka consumer groups, introduced in KIP-122 KIP-122 added the ability for kafka-consumer-groups.sh to reset/change consumer offsets, at a fine grained level. There is documentation on it in the kafka-consumer-groups.sh usage text. There was no such documentation on the kafka.apache.org website. This change updates the documentation on the website, so that users can read about the functionality without having the tools installed. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Assignee: Mayank Tankhiwale >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337719#comment-16337719 ] Mayank Tankhiwale commented on KAFKA-6312: -- [~prasanna1433] if you are not looking into this one, I'd like to assign this to myself. > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng >Priority: Major > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318089#comment-16318089 ] Manikumar commented on KAFKA-6312: -- [~prasanna1433] You can follow below links: http://kafka.apache.org/contributing https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Website+Documentation+Changes > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (KAFKA-6312) Add documentation about kafka-consumer-groups.sh's ability to set/change offsets
[ https://issues.apache.org/jira/browse/KAFKA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306667#comment-16306667 ] Prasanna Subburaj commented on KAFKA-6312: -- I can take up this task. Since I am new to the JIRA board can some direct me to a page that has information on how we need to add the documentation on kafka.apache.org and who will review the documentation that I prepare before it appears in the website. Please let me know how to proceed. > Add documentation about kafka-consumer-groups.sh's ability to set/change > offsets > > > Key: KAFKA-6312 > URL: https://issues.apache.org/jira/browse/KAFKA-6312 > Project: Kafka > Issue Type: Improvement > Components: documentation >Reporter: James Cheng > Labels: newbie > > KIP-122 added the ability for kafka-consumer-groups.sh to reset/change > consumer offsets, at a fine grained level. > There is documentation on it in the kafka-consumer-groups.sh usage text. > There is no such documentation on the kafka.apache.org website. We should add > some documentation to the website, so that users can read about the > functionality without having the tools installed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
