[jira] [Commented] (KAFKA-1989) New purgatory design

2015-05-27 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561470#comment-14561470
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Thanks. I am looking into it. Would you file a separate ticket for this? 

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Fix For: 0.8.3

 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch, KAFKA-1989_2015-04-08_14:29:51.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-05-27 Thread Onur Karaman (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561481#comment-14561481
 ] 

Onur Karaman commented on KAFKA-1989:
-

Here's the ticket: https://issues.apache.org/jira/browse/KAFKA-2226

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Fix For: 0.8.3

 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch, KAFKA-1989_2015-04-08_14:29:51.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-05-27 Thread Onur Karaman (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561366#comment-14561366
 ] 

Onur Karaman commented on KAFKA-1989:
-

Hi Yasuhiro.

A NullPointerException sometimes shows up in TimerTaskList.remove while running 
TestPurgatoryPerformance. I’m on the HEAD of trunk.
{code}
 ./bin/kafka-run-class.sh kafka.TestPurgatoryPerformance --key-space-size 
 10 --keys 3 --num 10 --pct50 50 --pct75 75 --rate 1000 --size 50 
 --timeout 20
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/Users/okaraman/code/kafka/core/build/dependant-libs-2.10.5/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/Users/okaraman/code/kafka/core/build/dependant-libs-2.10.5/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[2015-05-27 10:02:14,782] ERROR [completion thread], Error due to  
(kafka.TestPurgatoryPerformance$CompletionQueue$$anon$1)
java.lang.NullPointerException
  at kafka.utils.timer.TimerTaskList.remove(TimerTaskList.scala:80)
  at kafka.utils.timer.TimerTaskEntry.remove(TimerTaskList.scala:128)
  at kafka.utils.timer.TimerTask$class.cancel(TimerTask.scala:27)
  at kafka.server.DelayedOperation.cancel(DelayedOperation.scala:50)
  at kafka.server.DelayedOperation.forceComplete(DelayedOperation.scala:71)
  at 
kafka.TestPurgatoryPerformance$CompletionQueue$$anon$1.doWork(TestPurgatoryPerformance.scala:263)
  at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
{code}

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Fix For: 0.8.3

 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch, KAFKA-1989_2015-04-08_14:29:51.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-08 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14485950#comment-14485950
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Updated reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-08 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486099#comment-14486099
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Updated reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch, KAFKA-1989_2015-04-08_14:29:51.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-08 Thread Guozhang Wang (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486235#comment-14486235
 ] 

Guozhang Wang commented on KAFKA-1989:
--

This is great, thanks [~yasuhiro.matsuda]!

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Fix For: 0.8.3

 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch, 
 KAFKA-1989_2015-04-08_13:27:59.patch, KAFKA-1989_2015-04-08_14:29:51.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-07 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484170#comment-14484170
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Updated reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch, KAFKA-1989_2015-04-07_14:59:33.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-01 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391422#comment-14391422
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Updated reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch, 
 KAFKA-1989_2015-04-01_13:49:58.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-03-20 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371503#comment-14371503
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Updated reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch, KAFKA-1989_2015-03-20_08:44:57.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-02-27 Thread Yasuhiro Matsuda (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341070#comment-14341070
 ] 

Yasuhiro Matsuda commented on KAFKA-1989:
-

Created reviewboard https://reviews.apache.org/r/31568/diff/
 against branch origin/trunk

 New purgatory design
 

 Key: KAFKA-1989
 URL: https://issues.apache.org/jira/browse/KAFKA-1989
 Project: Kafka
  Issue Type: Improvement
  Components: purgatory
Affects Versions: 0.8.2.0
Reporter: Yasuhiro Matsuda
Assignee: Yasuhiro Matsuda
Priority: Critical
 Attachments: KAFKA-1989.patch


 This is a new design of purgatory based on Hierarchical Timing Wheels.
 https://cwiki.apache.org/confluence/display/KAFKA/Purgatory+Redesign+Proposal



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)