Daniele Ascione created KAFKA-7794:
--------------------------------------
Summary: kafka.tools.GetOffsetShell does not return the offset in
some cases
Key: KAFKA-7794
URL: https://issues.apache.org/jira/browse/KAFKA-7794
Project: Kafka
Issue Type: Bug
Components: tools
Affects Versions: 0.10.2.2, 0.10.2.1, 0.10.2.0
Reporter: Daniele Ascione
For some input for the timestamps (different from -1 or -2) the GetOffset is
not able to retrieve the offset.
For example, if _x_ is the timestamp in that "not working range", and you
execute:
{code:java}
bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list $KAFKA_ADDRESS
--topic $MY_TOPIC--time x
{code}
The output is:
{code:java}
MY_TOPIC:8:
MY_TOPIC:2:
MY_TOPIC:5:
MY_TOPIC:4:
MY_TOPIC:7:
MY_TOPIC:1:
MY_TOPIC:9:{code}
while after the last ":" an integer representing the offset is expected.
----
Steps to reproduce it:
# Consume all the messages from the beginning with the timestamp:
{code:java}
bin/kafka-simple-consumer-shell.sh --no-wait-at-logend --broker-list
$KAFKA_ADDRESS --topic $MY_TOPIC --property print.timestamp=true >
messages{code}
# Sort the messages by timestamp and get some of the oldest messages:
{code:java}
awk -F "CreateTime:" '{ print $2}' messages > msg_sorted{code}
# Take (for example) the timestamp of the 10th oldest message, and see if
GetOffsetShell is not able to print the offset:
{code:java}
timestamp="$(sed '10q;d' invals.ts.sorted.txt | cut -f1)"
bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list $KAFKA_ADDRESS
--topic $MY_TOPIC--time $timestamp
# The output should be something like:
# MY_TOPIC:1:
# MY_TOPIC:2:
(repeated for every partition){code}
# Verify that the message with that timestamp is still in Kafka:
{code:java}
bin/kafka-simple-consumer-shell.sh --no-wait-at-logend --broker-list
$KAFKA_ADDRESS --topic $MY_TOPIC --property print.timestamp=true | grep
"CreateTime:$timestamp" {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
