[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450387#comment-15450387 ] Eric Wasserman commented on KAFKA-1981: --- Opened new pull request at: https://github.com/apache/kafka

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357222#comment-15357222 ] Eric Wasserman commented on KAFKA-1981: --- [~junrao] could you please take a look at the pull request

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345618#comment-15345618 ] Eric Wasserman commented on KAFKA-1981: --- [~ijuma] do you think you have a chance to check out

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325578#comment-15325578 ] Eric Wasserman commented on KAFKA-1981: --- [~ijuma] A new pull request is available (https

[jira] [Comment Edited] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317588#comment-15317588 ] Eric Wasserman edited comment on KAFKA-1981 at 6/7/16 12:56 AM: During

[jira] [Comment Edited] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317588#comment-15317588 ] Eric Wasserman edited comment on KAFKA-1981 at 6/7/16 12:56 AM: During

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317588#comment-15317588 ] Eric Wasserman commented on KAFKA-1981: --- During the KIP-58 vote it was [suggested](http://mail

RE: [VOTE] KIP-58 - Make Log Compaction Point Configurable

During the vote it was suggested the name of the property be changed from: log.cleaner.compaction.lag.ms to log.cleaner.compaction.delay.ms Note that this feature concerns controlling the portion of the head of the log (new messages go on the head) that will be left un-compacted (i.e.

RE: [VOTE] KIP-58 - Make Log Compaction Point Configurable

Thanks everyone for voting. The vote passed with 5 binding +1's (Gwen, Jay, Ewen, Ismael, Jun) and with 9 nb's (Becket, James, Tom, Mnikumar, Ben, Grant, Joel, Eric) The discussion should move to KAFKA-1981

[VOTE] KIP-58 - Make Log Compaction Point Configurable

Hi, I would like to begin voting on KIP-58 - Make Log Compaction Point Configurable KIP-58 is here: < https://cwiki.apache.org/confluence/display/KAFKA/KIP-58+-+Make+Log+Compaction+Point+Configurable > The Jira ticket KAFKA-1981 Make log compaction point configurable is here:

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

James, Your pictures do an excellent job of illustrating my point. My mention of the additional "10's of minutes to hours" refers to how far after the original target checkpoint (T1 in your diagram) on may need to go to get to a checkpoint where all partitions of all topics are in the

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

ta that are not "committed" > yet), we continue reading to the log end until we get to a consistent > state. > > I am not convinced the new functionality is necessary, or even helpful. > > Gwen > > On Mon, May 16, 2016 at 4:07 PM, Eric Wasserman > <eric.wa

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285617#comment-15285617 ] Eric Wasserman commented on KAFKA-1981: --- Thanks, I added your use case. I would like to start

[DISCUSS] KIP-58 - Make Log Compaction Point Configurable

I would like to begin discussion on KIP-58 The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-58+-+Make+Log+Compaction+Point+Configurable Jira: https://issues.apache.org/jira/browse/KAFKA-1981 Pull Request: https://github.com/apache/kafka/pull/1168 Thanks, Eric

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275920#comment-15275920 ] Eric Wasserman commented on KAFKA-1981: --- That did it. Thanks. I created https://cwiki.apache.org

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275024#comment-15275024 ] Eric Wasserman commented on KAFKA-1981: --- I think it must be the same as my Jira user: ewasserman

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274751#comment-15274751 ] Eric Wasserman commented on KAFKA-1981: --- I attached a KIP to this Jira ticket as I don't have

KAFKA-1981 Make log compaction point configurable

I was requested by Ismael Juma ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=ijuma) to create a KIP for this patch because it adds configurations. I don't have the permissions in Confluence to add a child to the KIP page as instructed. Instead I added a markdown document as an

[jira] [Updated] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated KAFKA-1981: -- Attachment: KIP for Kafka Compaction Patch.md Attached a KIP as I cannot add one in Confluence

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250643#comment-15250643 ] Eric Wasserman commented on KAFKA-1981: --- I apparently don't have any privileges to create a KIP

"nag" for Pull Request

Following the advice on http://kafka.apache.org/contributing.html > this email is a "nag" for the PR https://github.com/apache/kafka/pull/1168