[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-30 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609514#comment-14609514 ] Ben Lau commented on HBASE-13991: - Hi guys, thanks for all the feedback. I think we

[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-07-06 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615813#comment-14615813 ] Ben Lau commented on HBASE-13991: - Hi guys, hope you had a happy 4th of July. We would

[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606793#comment-14606793 ] Ben Lau commented on HBASE-13991: - Sure. Created a reviewboard request here:

[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Attachment: HumongousTableDoc.pdf Hierarchical Layout for Humongous Tables

[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Attachment: HBASE-13991-master.patch Hierarchical Layout for Humongous Tables

[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Description: Add support for humongous tables via a hierarchical layout for regions on filesystem.

[jira] [Created] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
Ben Lau created HBASE-13991: --- Summary: Hierarchical Layout for Humongous Tables Key: HBASE-13991 URL: https://issues.apache.org/jira/browse/HBASE-13991 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-21 Thread Ben Lau (JIRA)
Ben Lau created HBASE-14283: --- Summary: Reverse scan doesn’t work with HFile inline index/bloom blocks Key: HBASE-14283 URL: https://issues.apache.org/jira/browse/HBASE-14283 Project: HBase Issue

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707096#comment-14707096 ] Ben Lau commented on HBASE-14283: - In the patch I also added an extra unit test to

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707088#comment-14707088 ] Ben Lau commented on HBASE-14283: - We suspect the person in HBASE-13830 also ran into

[jira] [Updated] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14283: Attachment: hfile-seek-before.patch Reverse scan doesn’t work with HFile inline index/bloom blocks

[jira] [Commented] (HBASE-13830) Hbase REVERSED may throw Exception sometimes

2015-08-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707111#comment-14707111 ] Ben Lau commented on HBASE-13830: - Possibly the same bug as in HBASE-14283, or related.

[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606521#comment-14606521 ] Ben Lau commented on HBASE-13991: - The HBase master doesn't write much to disk compared

[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Description: Add support for humongous tables via a hierarchical layout for regions on filesystem.

[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-06-29 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606940#comment-14606940 ] Ben Lau commented on HBASE-13991: - I don't think we had one planned but if there were

[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-07-28 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Description: Add support for humongous tables via a hierarchical layout for regions on filesystem.

[jira] [Commented] (HBASE-13830) Hbase REVERSED may throw Exception sometimes

2015-08-03 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652873#comment-14652873 ] Ben Lau commented on HBASE-13830: - Hey Ryan, do you have more information on this bug.

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-27 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976020#comment-14976020 ] Ben Lau commented on HBASE-14283: - Reran the failures that looked relevant on the various branches, seems

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975101#comment-14975101 ] Ben Lau commented on HBASE-14283: - Thanks Andrew. Can we merge these patches or is there still something

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975489#comment-14975489 ] Ben Lau commented on HBASE-14283: - That's odd, something went wrong with the patch for 1.1 branch. That

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975584#comment-14975584 ] Ben Lau commented on HBASE-14283: - Ok thanks just wanted to confirm the other branches were fine as far

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975570#comment-14975570 ] Ben Lau commented on HBASE-14283: - [~andrew.purt...@gmail.com] Was the wrong patch applied to 1.1 or am I

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974587#comment-14974587 ] Ben Lau commented on HBASE-14283: - Still there [~andrew.purt...@gmail.com]? Anyone else have

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956228#comment-14956228 ] Ben Lau commented on HBASE-14283: - So anything I should change in the patches? How many +1's are needed?

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956541#comment-14956541 ] Ben Lau commented on HBASE-14283: - [~lhofhansl] and [~anoop.hbase], I probably should’ve called it out

[jira] [Updated] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14283: Attachment: HBASE-14283-reupload-master.patch Attached a new patch for master, same as the previous patch

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-07 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948049#comment-14948049 ] Ben Lau commented on HBASE-14283: - Hmmm, can't seem to edit Jira comments. Anyways, I attached short

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-07 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947873#comment-14947873 ] Ben Lau commented on HBASE-14283: - Alright I'll work on that. I created HBASE-14576 for the longer term

[jira] [Created] (HBASE-14576) New HFile version for optimized reverse scans

2015-10-07 Thread Ben Lau (JIRA)
Ben Lau created HBASE-14576: --- Summary: New HFile version for optimized reverse scans Key: HBASE-14576 URL: https://issues.apache.org/jira/browse/HBASE-14576 Project: HBase Issue Type: Improvement

[jira] [Updated] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-07 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14283: Attachment: HBASE-14283-master.patch HBASE-14283-branch-1.patch

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959998#comment-14959998 ] Ben Lau commented on HBASE-14283: - [~andrew.purt...@gmail.com] Let me know if I'm missing something, but

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965794#comment-14965794 ] Ben Lau commented on HBASE-14283: - [~andrew.purt...@gmail.com] Is the above explanation agreeable? >

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-10-06 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946197#comment-14946197 ] Ben Lau commented on HBASE-14283: - Hey guys, sorry, I should be able to get back to this soon. Finishing

[jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables

2015-07-09 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621502#comment-14621502 ] Ben Lau commented on HBASE-13991: - Hi stack, we did consider doing an online migration

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-26 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715147#comment-14715147 ] Ben Lau commented on HBASE-14283: - Hi Anoop. The problem isn't that we read a previous

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-27 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717095#comment-14717095 ] Ben Lau commented on HBASE-14283: - Thanks ramkrishna. I will take a crack at fixing the

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-24 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710583#comment-14710583 ] Ben Lau commented on HBASE-14283: - Anyone have any comments on this bug and the fix?

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-25 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711760#comment-14711760 ] Ben Lau commented on HBASE-14283: - Thanks [~ramkrishna.s.vasude...@gmail.com] for showing

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-31 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724040#comment-14724040 ] Ben Lau commented on HBASE-14283: - Correct me if I'm wrong but I think I can't do a generalBloomFilter ==

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-31 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724104#comment-14724104 ] Ben Lau commented on HBASE-14283: - The other parts of the code consider BloomFilter to be a nullable

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-31 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724107#comment-14724107 ] Ben Lau commented on HBASE-14283: - Alright I'll put it on reviewboard, thanks. > Reverse scan doesn’t

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-31 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724357#comment-14724357 ] Ben Lau commented on HBASE-14283: - Reviewboard link with updated version of patch (v3):

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-08 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736093#comment-14736093 ] Ben Lau commented on HBASE-14283: - Yep, we talked with Anoop and agree that the patch adds a lot of

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746484#comment-14746484 ] Ben Lau commented on HBASE-14283: - After talking to some committers in HBase, it seems that unless there

[jira] [Updated] (HBASE-14439) New/Improved Filesystem Abstractions

2015-09-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14439: Description: Ticket for work in progress on new FileSystem abstractions. Previously, we (Yahoo)

[jira] [Created] (HBASE-14439) New Filesystem Abstraction Layer

2015-09-15 Thread Ben Lau (JIRA)
Ben Lau created HBASE-14439: --- Summary: New Filesystem Abstraction Layer Key: HBASE-14439 URL: https://issues.apache.org/jira/browse/HBASE-14439 Project: HBase Issue Type: New Feature

[jira] [Updated] (HBASE-14439) New Filesystem Abstraction Layer

2015-09-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14439: Attachment: abstraction.patch > New Filesystem Abstraction Layer > > >

[jira] [Updated] (HBASE-14439) New/Improved Filesystem Abstractions

2015-09-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14439: Description: Ticket for work in progress on new FileSystem abstractions. Previously, we (Yahoo)

[jira] [Updated] (HBASE-14439) New/Improved Filesystem Abstractions

2015-09-15 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14439: Description: Ticket for work in progress on new FileSystem abstractions. Previously, we (Yahoo)

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744844#comment-14744844 ] Ben Lau commented on HBASE-14283: - Hey guys, I started looking into updating the HFile serialization to

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-09 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737171#comment-14737171 ] Ben Lau commented on HBASE-14283: - Yes we would be changing the serialization for HFileBlock header. It

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-24 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906704#comment-14906704 ] Ben Lau commented on HBASE-14283: - Hi guys, I have posted a new patch on review board. See

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-25 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909063#comment-14909063 ] Ben Lau commented on HBASE-14283: - As Matteo mentions, we discussed this issue briefly with him and Stack

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-09-24 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906728#comment-14906728 ] Ben Lau commented on HBASE-14283: - Hi Nick, that sounds like a good idea, I will do that. > Reverse scan

[jira] [Commented] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-28 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720844#comment-14720844 ] Ben Lau commented on HBASE-14283: - Here's a V2 of the patch that handles bloom filter

[jira] [Updated] (HBASE-14283) Reverse scan doesn’t work with HFile inline index/bloom blocks

2015-08-28 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-14283: Attachment: HBASE-14283-v2.patch Reverse scan doesn’t work with HFile inline index/bloom blocks

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-16 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Attachment: HBASE-16052-master.patch > Improve HBaseFsck Scalability > - > >

[jira] [Created] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-16 Thread Ben Lau (JIRA)
Ben Lau created HBASE-16052: --- Summary: Improve HBaseFsck Scalability Key: HBASE-16052 URL: https://issues.apache.org/jira/browse/HBASE-16052 Project: HBase Issue Type: Improvement

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342282#comment-15342282 ] Ben Lau commented on HBASE-16052: - [~jmhsieh] and [~jxiang] Any comments on this patch? Just checking

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-22 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345499#comment-15345499 ] Ben Lau commented on HBASE-16052: - Added a comment about a refactor that may clean up / unify the FSUtils

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340148#comment-15340148 ] Ben Lau commented on HBASE-16052: - Reviewboard link: https://reviews.apache.org/r/48959/ Added

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-27 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351422#comment-15351422 ] Ben Lau commented on HBASE-16052: - Thanks guys. The patch doesn't apply cleanly to branch-1 so I will

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-27 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351586#comment-15351586 ] Ben Lau commented on HBASE-16052: - Uploaded the patch for branch-1. Re-ran the Fsck unit tests which

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-06-27 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Attachment: HBASE-16052-v3-branch-1.patch > Improve HBaseFsck Scalability > -

[jira] [Commented] (HBASE-14576) New HFile version for optimized reverse scans

2016-05-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290115#comment-15290115 ] Ben Lau commented on HBASE-14576: - Hi [~syuanjiang] I'm not currently working on the hfile format

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Attachment: HBASE-16052-0.98.v3-amendment.patch Seems it should just be this method call. [~tedyu] can

[jira] [Comment Edited] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386493#comment-15386493 ] Ben Lau edited comment on HBASE-16052 at 7/20/16 7:42 PM: -- Seems it should just

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386372#comment-15386372 ] Ben Lau commented on HBASE-16052: - Looks like some of the methods don't exist on Hadoop 1.1. When I ran

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Status: Patch Available (was: In Progress) > Improve HBaseFsck Scalability >

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382689#comment-15382689 ] Ben Lau commented on HBASE-16052: - [~busbey] Thanks! > Improve HBaseFsck Scalability >

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382638#comment-15382638 ] Ben Lau commented on HBASE-16052: - [~tedyu] / [~syuanjiang] How does the 0.98 patch look? Is there a way

[jira] [Work started] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-16052 started by Ben Lau. --- > Improve HBaseFsck Scalability > - > > Key:

[jira] [Reopened] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau reopened HBASE-16052: - Re-opening to trigger test on 0.98 patch. > Improve HBaseFsck Scalability > - >

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-18 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Attachment: HBASE-16052-0.98.v3.patch Thanks [~tedyu] -- done. > Improve HBaseFsck Scalability >

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-19 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384626#comment-15384626 ] Ben Lau commented on HBASE-16052: - Test failure looks unrelated to me. Reran locally and passed. Let me

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-12 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Attachment: HBASE-16052-v3-0.98.patch Attached patch for 0.98. Let me know if this looks good

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-06 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365175#comment-15365175 ] Ben Lau commented on HBASE-16052: - Ah okay, good to know, thanks. > Improve HBaseFsck Scalability >

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-06 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365169#comment-15365169 ] Ben Lau commented on HBASE-16052: - Hi Ted, I can probably get to it on Monday. Just to make sure I

[jira] [Commented] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-01 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359848#comment-15359848 ] Ben Lau commented on HBASE-16052: - Okay let me know if you guys have a consensus for what other versions

[jira] [Updated] (HBASE-16052) Improve HBaseFsck Scalability

2016-07-01 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16052: Release Note: HBASE-16052 improves the performance and scalability of HBaseFsck, especially for large

[jira] [Updated] (HBASE-16662) Fix open POODLE vulnerabilities

2016-09-21 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16662: Status: Patch Available (was: Open) Formally submit patch file (not sure if I did this right). > Fix

[jira] [Created] (HBASE-16662) Fix open POODLE vulnerabilities

2016-09-20 Thread Ben Lau (JIRA)
Ben Lau created HBASE-16662: --- Summary: Fix open POODLE vulnerabilities Key: HBASE-16662 URL: https://issues.apache.org/jira/browse/HBASE-16662 Project: HBase Issue Type: Bug Components:

[jira] [Updated] (HBASE-16662) Fix open POODLE vulnerabilities

2016-09-20 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-16662: Attachment: HBASE-16662-master.patch > Fix open POODLE vulnerabilities > --- >

[jira] [Resolved] (HBASE-17720) Possible bug in FlushSnapshotSubprocedure

2017-03-02 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau resolved HBASE-17720. - Resolution: Duplicate > Possible bug in FlushSnapshotSubprocedure >

[jira] [Commented] (HBASE-17720) Possible bug in FlushSnapshotSubprocedure

2017-03-02 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892973#comment-15892973 ] Ben Lau commented on HBASE-17720: - Ah, thanks Jerry. It looks like the fix was added in HBASE-13877

[jira] [Created] (HBASE-17720) Possible bug in FlushSnapshotSubprocedure

2017-03-02 Thread Ben Lau (JIRA)
Ben Lau created HBASE-17720: --- Summary: Possible bug in FlushSnapshotSubprocedure Key: HBASE-17720 URL: https://issues.apache.org/jira/browse/HBASE-17720 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19989) READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly

2018-02-12 Thread Ben Lau (JIRA)
Ben Lau created HBASE-19989: --- Summary: READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly Key: HBASE-19989 URL: https://issues.apache.org/jira/browse/HBASE-19989 Project: HBase

[jira] [Updated] (HBASE-19989) READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly

2018-02-12 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-19989: Attachment: HBASE-19989.patch > READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly >

[jira] [Commented] (HBASE-15911) NPE in AssignmentManager.onRegionTransition after Master restart

2018-02-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363161#comment-16363161 ] Ben Lau commented on HBASE-15911: - [~pankaj2461] [~mantonov] We recently ran into this and had to fix

[jira] [Commented] (HBASE-19989) READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly

2018-02-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363081#comment-16363081 ] Ben Lau commented on HBASE-19989: - Hi Ted, thanks for the feedback, I'm not sure a comment will be

[jira] [Updated] (HBASE-19989) READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly

2018-02-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-19989: Attachment: (was: HBASE-19989.patch) > READY_TO_MERGE and READY_TO_SPLIT do not update region state

[jira] [Updated] (HBASE-19989) READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly

2018-02-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-19989: Attachment: HBASE-19989.patch > READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly >

[jira] [Commented] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-13 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363168#comment-16363168 ] Ben Lau commented on HBASE-18282: - Hi guys, this ticket has been open for a while.  Do you mind if we

[jira] [Created] (HBASE-19995) Current Jetty 9 version in HBase master branch can memory leak under high traffic

2018-02-13 Thread Ben Lau (JIRA)
Ben Lau created HBASE-19995: --- Summary: Current Jetty 9 version in HBase master branch can memory leak under high traffic Key: HBASE-19995 URL: https://issues.apache.org/jira/browse/HBASE-19995 Project:

[jira] [Updated] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-18282: Attachment: HBASE-18282-branch-2.patch HBASE-18282-branch-1.patch > ReplicationLogCleaner

[jira] [Commented] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364666#comment-16364666 ] Ben Lau commented on HBASE-18282: - Thanks [~apurtell].  It looks like this code is rewritten in master

[jira] [Updated] (HBASE-19995) Current Jetty 9 version in HBase master branch can memory leak under high traffic

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-19995: Attachment: HBASE-19995.patch > Current Jetty 9 version in HBase master branch can memory leak under high

[jira] [Commented] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365001#comment-16365001 ] Ben Lau commented on HBASE-18282: - [~yuzhih...@gmail.com] I wasn't sure when that sleep can be

[jira] [Updated] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-18282: Attachment: HBASE-18282-branch-2-v2.patch HBASE-18282-branch-1-v2.patch >

[jira] [Commented] (HBASE-18282) ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException

2018-02-14 Thread Ben Lau (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365010#comment-16365010 ] Ben Lau commented on HBASE-18282: - Hi [~yuzhih...@gmail.com], as explained earlier, I believe this bug to

  1   2   >