[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3163: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 1215 [https://github.com/apache/kafka/pull/1215] > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.1.0 > > Attachments: 00113931.log, 00113931.timeindex > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3163: --- Attachment: 00113931.timeindex 00113931.log Also, I ran the following tool in the patch on the attached timeindex file and got a bunch of errors. kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/test-0/00113931.timeindex timestamp: 1468010788307(log timestamp: 1468010788303) offset: 113946(log offset: 113931) timestamp: 1468010788308(log timestamp: 1468010788303) offset: 113976(log offset: 113931) timestamp: 1468010788309(log timestamp: 1468010788303) offset: 114006(log offset: 113931) timestamp: 1468010788310(log timestamp: 1468010788303) offset: 114036(log offset: 113931) timestamp: 1468010788311(log timestamp: 1468010788303) offset: 114081(log offset: 113931) timestamp: 1468010788312(log timestamp: 1468010788303) offset: 114111(log offset: 113931) timestamp: 1468010788313(log timestamp: 1468010788303) offset: 114156(log offset: 113931) timestamp: 1468010788314(log timestamp: 1468010788303) offset: 114201(log offset: 113931) Found timestamp mismatch in :/tmp/kafka-logs/test-0/00113931.timeindex Index timestamp: 1468010788314, log timestamp: 1468010788303 Index timestamp: 1468010788313, log timestamp: 1468010788303 Index timestamp: 1468010788312, log timestamp: 1468010788303 Index timestamp: 1468010788311, log timestamp: 1468010788303 Index timestamp: 1468010788310, log timestamp: 1468010788303 Index timestamp: 1468010788309, log timestamp: 1468010788303 Index timestamp: 1468010788308, log timestamp: 1468010788303 Index timestamp: 1468010788307, log timestamp: 1468010788303 A few things: (1) The data is populated with the producer performance tool. So, the time index shouldn't be corrupted. (2) It's a bit hard to understand the output. It's not clear what's in the bracket really means and it's not clear that indicates an error. It's also a bit weird that the same error is print again later and in reverse timestamp order. > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.1.0 > > Attachments: 00113931.log, 00113931.timeindex > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3163: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.1.0 > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-3163: Reviewer: Jun Rao > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.0.0 > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-3163: Status: Patch Available (was: Open) > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.0.0 > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3163: --- Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.10.1.0 > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3163: --- Fix Version/s: (was: 0.10.0.0) 0.9.1.0 > KIP-33 - Add a time based log index to Kafka > > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core >Reporter: Jiangjie Qin >Assignee: Jiangjie Qin > Fix For: 0.9.1.0 > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)
