[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-05 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896860#comment-15896860 ] deepankar commented on HBASE-16630: --- Thanks guys for pushing this and dealing with my errors and

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895615#comment-15895615 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.2-JDK7 #111 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895602#comment-15895602 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.2-JDK8 #106 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895545#comment-15895545 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.2-IT #844 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-03 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893882#comment-15893882 ] ramkrishna.s.vasudevan commented on HBASE-16630: [~dvdreddy] You want me prepare a patch

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890868#comment-15890868 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.3-JDK8 #129 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890731#comment-15890731 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.4 #653 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890493#comment-15890493 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.3-JDK7 #118 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890098#comment-15890098 ] ramkrishna.s.vasudevan commented on HBASE-16630: I corrected the patch subject manually

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890034#comment-15890034 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.3-JDK7 #117 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889973#comment-15889973 ] Hudson commented on HBASE-16630: FAILURE: Integrated in Jenkins build HBase-1.2-IT #608 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889954#comment-15889954 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.4 #652 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889903#comment-15889903 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.3-JDK8 #128 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889844#comment-15889844 ] ramkrishna.s.vasudevan commented on HBASE-16630: There are no compilation issues now. >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889774#comment-15889774 ] ramkrishna.s.vasudevan commented on HBASE-16630: [~dvdreddy] I think the patch name

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889763#comment-15889763 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.2-JDK7 #109 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889752#comment-15889752 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.2-JDK8 #103 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889710#comment-15889710 ] deepankar commented on HBASE-16630: --- Sorry guys I forgot to check for compilation and other minor

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889632#comment-15889632 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-1.3-IT #841 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889570#comment-15889570 ] ramkrishna.s.vasudevan commented on HBASE-16630: Reverted from branch-1 and branch-3.

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889560#comment-15889560 ] Sean Busbey commented on HBASE-16630: - reverted from branch-1.2 because it caused a compilation

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889528#comment-15889528 ] ramkrishna.s.vasudevan commented on HBASE-16630: [~dvdreddy] There is a compilation

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889526#comment-15889526 ] Hudson commented on HBASE-16630: FAILURE: Integrated in Jenkins build HBase-1.3-JDK7 #116 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889510#comment-15889510 ] deepankar commented on HBASE-16630: --- Created HBASE-17711 for tracking the addition of tests for this

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889508#comment-15889508 ] ramkrishna.s.vasudevan commented on HBASE-16630: Pushed to branch-1, branch-1.2 and

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889489#comment-15889489 ] Hadoop QA commented on HBASE-16630: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889163#comment-15889163 ] Hadoop QA commented on HBASE-16630: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882960#comment-15882960 ] Hudson commented on HBASE-16630: SUCCESS: Integrated in Jenkins build HBase-Trunk_matrix #2563 (See

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882321#comment-15882321 ] ramkrishna.s.vasudevan commented on HBASE-16630: Pushed to master. Thanks for the patch

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882300#comment-15882300 ] ramkrishna.s.vasudevan commented on HBASE-16630: Ok I can commit it. > Fragmentation in

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882284#comment-15882284 ] Anoop Sam John commented on HBASE-16630: Yep 1.2+ all branches can be the target.

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882011#comment-15882011 ] ramkrishna.s.vasudevan commented on HBASE-16630: Which of the above patches should be

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881995#comment-15881995 ] ramkrishna.s.vasudevan commented on HBASE-16630: +1 for commit to master and branch -

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-23 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881840#comment-15881840 ] Sean Busbey commented on HBASE-16630: - seems fine for branch-1.2, but doesn't seem worth blocking

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881825#comment-15881825 ] stack commented on HBASE-16630: --- +1 Go for it. Should it go into hbase-1.2.5 [~anoop.hbase]? [~busbey] FYI

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-10 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861696#comment-15861696 ] deepankar commented on HBASE-16630: --- About the unit test, I was busy past weeks trying to hunt down

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-02-10 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861029#comment-15861029 ] Anoop Sam John commented on HBASE-16630: Looks good. Can we get this in now? Ping

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-17 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827327#comment-15827327 ] chunhui shen commented on HBASE-16630: -- [~dvdreddy] The method of freeEntireBuckets should return

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-17 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827291#comment-15827291 ] chunhui shen commented on HBASE-16630: -- bq. If its harmless, why commit it (smile)? I mean it's

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-17 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826660#comment-15826660 ] deepankar commented on HBASE-16630: --- Sorry I forgot about the unit test, will see If I hack get

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826158#comment-15826158 ] stack commented on HBASE-16630: --- bq. The patch is fine and would be harmless. If its harmless, why commit

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825595#comment-15825595 ] chunhui shen commented on HBASE-16630: -- [~stack] Our change about this which is mentioned in the

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825508#comment-15825508 ] stack commented on HBASE-16630: --- [~dvdreddy] And thanks for trying my suggestion though it sounds like it

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825479#comment-15825479 ] stack commented on HBASE-16630: --- [~dvdreddy] You think we should commit this last patch? Thanks. >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824847#comment-15824847 ] Ted Yu commented on HBASE-16630: Planning to commit tomorrow morning if there is no more review comment.

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824206#comment-15824206 ] Ted Yu commented on HBASE-16630: +1 from me as well. > Fragmentation in long running Bucket Cache >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824150#comment-15824150 ] Ted Yu commented on HBASE-16630: Ran TestAsyncTableBatch with patch locally and didn't reproduce test

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823598#comment-15823598 ] Hadoop QA commented on HBASE-16630: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2017-01-15 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823377#comment-15823377 ] chunhui shen commented on HBASE-16630: -- seems fine for the latest patch, +1 > Fragmentation in long

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-12-20 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766090#comment-15766090 ] ramkrishna.s.vasudevan commented on HBASE-16630: [~dvdreddy] Thanks for the info. We can

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-12-20 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765587#comment-15765587 ] deepankar commented on HBASE-16630: --- Sorry for the late reply, I looked into Stack's suggestion and

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-12-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763307#comment-15763307 ] ramkrishna.s.vasudevan commented on HBASE-16630: [~dvdreddy] Do you have some time to

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-11-04 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635468#comment-15635468 ] deepankar commented on HBASE-16630: --- Yeah I am looking into stacks suggestion to counter the problem I

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-11-03 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635307#comment-15635307 ] Anoop Sam John commented on HBASE-16630: We would like to enable BucketCache On by default for

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-11-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626247#comment-15626247 ] stack commented on HBASE-16630: --- [~dvdreddy] Could you use the 'smarter' algo from HBASE-15560

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626001#comment-15626001 ] Ted Yu commented on HBASE-16630: bq. repeatedly eviciting the same blocks again How about keeping last

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-10-16 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15580415#comment-15580415 ] deepankar commented on HBASE-16630: --- Sorry for the delayed reply, the bucket cache is not stuck as

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-10-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561095#comment-15561095 ] Ted Yu commented on HBASE-16630: Deepankar: How was the patched version running in your cluster ? Thanks

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514645#comment-15514645 ] Vladimir Rodionov commented on HBASE-16630: --- Yes, my bad. Somehow missed ! > Fragmentation

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514424#comment-15514424 ] Ted Yu commented on HBASE-16630: {code} + Set candidateBuckets =

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514407#comment-15514407 ] Vladimir Rodionov commented on HBASE-16630: --- [~dvdreddy] OK, I was not right - do not see any

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514299#comment-15514299 ] deepankar commented on HBASE-16630: --- Which map are you referring to [~vrodionov] , I am constructing a

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513348#comment-15513348 ] Anoop Sam John commented on HBASE-16630: Is there a way we can get the possible candidates of

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-21 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510385#comment-15510385 ] Vladimir Rodionov commented on HBASE-16630: --- [~dvdreddy], memory requirements is very high.

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510294#comment-15510294 ] Ted Yu commented on HBASE-16630: If you have time, do you mind trying patch v2 on a (test) cluster ?

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508568#comment-15508568 ] Ted Yu commented on HBASE-16630: {code} +// Add buckets with blocks currently in use +for (Long

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-20 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508469#comment-15508469 ] deepankar commented on HBASE-16630: --- I used it predominently for limiting the number of buckets we

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508425#comment-15508425 ] Ted Yu commented on HBASE-16630: {code} +Set result = new HashSet<>(bucketCount); +

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-19 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505542#comment-15505542 ] chunhui shen commented on HBASE-16630: -- 1.Fix the issue that FreeSpace doesn't free anything

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-19 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505115#comment-15505115 ] deepankar commented on HBASE-16630: --- Yup looks like this is exactly what we want, the idea is to pick a

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-19 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505090#comment-15505090 ] Vladimir Rodionov commented on HBASE-16630: --- Google "slab calcification problem". This is

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-19 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504536#comment-15504536 ] deepankar commented on HBASE-16630: --- This is very good idea to make sure all the buckets have

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-19 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504518#comment-15504518 ] deepankar commented on HBASE-16630: --- Ha, nice point, I missed this, but this would still not guarantee,

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-17 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500076#comment-15500076 ] chunhui shen commented on HBASE-16630: -- Another thing to do : In one BucketCache#FreeSpace round,

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-17 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500060#comment-15500060 ] chunhui shen commented on HBASE-16630: -- {code} BucketCache#freeSpace if (needFreeForExtra) {

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-14 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490281#comment-15490281 ] Anoop Sam John commented on HBASE-16630: Ya that assert was just added as we always passed HBB at

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-14 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489646#comment-15489646 ] ramkrishna.s.vasudevan commented on HBASE-16630: Nice find. Some simiilar issue was

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489482#comment-15489482 ] deepankar commented on HBASE-16630: --- It is moving data, but the storage of the data (i.e byte buffers )

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489459#comment-15489459 ] Vladimir Rodionov commented on HBASE-16630: --- {quote} Defragmentation is the software one,

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489296#comment-15489296 ] deepankar commented on HBASE-16630: --- Commented on the comment above, SIGSEV should not be an issue as

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489291#comment-15489291 ] deepankar commented on HBASE-16630: --- The only problem is currently some IOEngines (Ex:-

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489287#comment-15489287 ] deepankar commented on HBASE-16630: --- This is correct, Defragmentation does not affect anything in the

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489282#comment-15489282 ] deepankar commented on HBASE-16630: --- I'll remove the full lock, essentially the lock is to make sure

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489253#comment-15489253 ] Vladimir Rodionov commented on HBASE-16630: --- How about block reads during defragmentation? I

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread binlijin (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489240#comment-15489240 ] binlijin commented on HBASE-16630: -- So it will affect flushing the RAM cache to IOEngine. >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489238#comment-15489238 ] Vladimir Rodionov commented on HBASE-16630: --- It requires full cache lock? > Fragmentation in

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489235#comment-15489235 ] Vladimir Rodionov commented on HBASE-16630: --- How about offheap read support? Does it include

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread binlijin (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489234#comment-15489234 ] binlijin commented on HBASE-16630: -- If i am not wrong, the Defragmentation is done by WriterThread,

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489225#comment-15489225 ] Vladimir Rodionov commented on HBASE-16630: --- Defragmentation is hard. (Full GC is an example).

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread binlijin (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489206#comment-15489206 ] binlijin commented on HBASE-16630: -- Looks like there is extra copy in deFragment, can we reduce it? >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489149#comment-15489149 ] Ted Yu commented on HBASE-16630: {code} + float nonZeroUsedCount = 0.0f, nonZeroFreeCount = 0.0f;

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread binlijin (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489130#comment-15489130 ] binlijin commented on HBASE-16630: -- Nice findingļ¼ > Fragmentation in long running Bucket Cache >

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-13 Thread deepankar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488995#comment-15488995 ] deepankar commented on HBASE-16630: --- ping [~stack], [~anoop.hbase], [~ram_krish], any suggestions ? >