[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923323#comment-16923323 ] Hudson commented on HBASE-22867: Results for branch branch-1.4 [build #997 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923319#comment-16923319 ] Hudson commented on HBASE-22867: Results for branch branch-1 [build #1048 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916106#comment-16916106 ] Andrew Purtell commented on HBASE-22867: Thank you for considering a backport. > The

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915415#comment-16915415 ] Zheng Hu commented on HBASE-22867: -- OK, so let's address the backport in HBASE-22912, I will

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914826#comment-16914826 ] Reid Chan commented on HBASE-22867: --- Filed HBASE-22912. > The ForkJoinPool in CleanerChore will spawn

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914803#comment-16914803 ] Reid Chan commented on HBASE-22867: --- {quote}Should this fix be backported too? (There are some Java 8

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914678#comment-16914678 ] Andrew Purtell commented on HBASE-22867: HBASE-18309 was backported to branch-1 on HBASE-20352.

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913932#comment-16913932 ] Hudson commented on HBASE-22867: Results for branch master [build #1354 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913920#comment-16913920 ] Hudson commented on HBASE-22867: Results for branch branch-2 [build #2185 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913898#comment-16913898 ] Hudson commented on HBASE-22867: Results for branch branch-2.2 [build #534 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913801#comment-16913801 ] Hudson commented on HBASE-22867: Results for branch branch-2.1 [build #1510 on

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912995#comment-16912995 ] Zheng Hu commented on HBASE-22867: -- [~anoop.hbase], Yes, let me file a new issue to address the

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912919#comment-16912919 ] Anoop Sam John commented on HBASE-22867: So this issue will fix the problem with too many

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912912#comment-16912912 ] Reid Chan commented on HBASE-22867: --- (y)[~openinx] > The ForkJoinPool in CleanerChore will spawn

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912869#comment-16912869 ] Zheng Hu commented on HBASE-22867: -- Attached two jstack files: 191318.stack and 191318.stack.1 . I

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911159#comment-16911159 ] Reid Chan commented on HBASE-22867: --- Good to know your plan. > The ForkJoinPool in CleanerChore will

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911136#comment-16911136 ] Zheng Hu commented on HBASE-22867: -- I agree there're two problems here: 1. no limit for FJP; 2. the

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911127#comment-16911127 ] Reid Chan commented on HBASE-22867: --- First skimmed, as i said, the root cause is not the choice of FJP

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909116#comment-16909116 ] Reid Chan commented on HBASE-22867: --- Need some time to understand the story of SnapshotHFileCleaner

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909115#comment-16909115 ] Reid Chan commented on HBASE-22867: --- The phenomenon is too much threads, but the reason behind is

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909059#comment-16909059 ] Duo Zhang commented on HBASE-22867: --- OK, both in fork and submit, we will try to create new workers if

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909029#comment-16909029 ] Duo Zhang commented on HBASE-22867: --- Reading the code, fork will only add the task to queue of the

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908983#comment-16908983 ] Reid Chan commented on HBASE-22867: --- Got point. > The ForkJoinPool in CleanerChore will spawn

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908960#comment-16908960 ] Duo Zhang commented on HBASE-22867: --- The parallelism is not the thread count. If there are lots of

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908959#comment-16908959 ] Zheng Hu commented on HBASE-22867: -- Seems it's not, you can see the threads dump in the attachment. I'm

[jira] [Commented] (HBASE-22867) The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table

[ https://issues.apache.org/jira/browse/HBASE-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908950#comment-16908950 ] Reid Chan commented on HBASE-22867: --- IIRC, the size of FJP is capped with