[ 
https://issues.apache.org/jira/browse/HBASE-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042720#comment-15042720
 ] 

Lars Hofhansl commented on HBASE-14922:
---------------------------------------

Looks like this break the mini cluster. I see a ton of this in the logs:
{code}
2015-12-04 22:55:48,215 ERROR [newbunny,41236,1449298547569_ChoreService_107] se
rver.NIOServerCnxnFactory$1(44): Thread 
Thread[newbunny,41236,1449298547569_ChoreService_107,5,main] died
java.lang.IllegalArgumentException: bound must be greater than origin
        at 
java.util.concurrent.ThreadLocalRandom.nextLong(ThreadLocalRandom.java:430)
        at 
org.apache.hadoop.hbase.JitterScheduledThreadPoolExecutorImpl$JitteredRunnableScheduledFuture.getDelay(JitterScheduledThreadPoolExecutorImpl.java:84)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1083)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{code}



> Delayed flush doesn't work causing flush storms.
> ------------------------------------------------
>
>                 Key: HBASE-14922
>                 URL: https://issues.apache.org/jira/browse/HBASE-14922
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 2.0.0, 1.2.0, 1.1.2
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>             Fix For: 2.0.0, 1.2.0, 1.3.0
>
>         Attachments: HBASE-14922-v1.patch, HBASE-14922-v2.patch, 
> HBASE-14922.patch
>
>
> Starting all regionservers at the same time will mean that most 
> PeriodicMemstoreFlusher's will be running at the same time. So all of these 
> threads will queue flushes at about the same time.
> This was supposed to be mitigated by Delayed. However that isn't nearly 
> enough. This results in the immediate filling up and then draining of the 
> flush queues every hour.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to