[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595746#comment-16595746 ] Hudson commented on HBASE-20649: Results for branch branch-2.1 [build #256 on

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595673#comment-16595673 ] Hudson commented on HBASE-20649: Results for branch branch-2.0 [build #745 on

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-08-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595089#comment-16595089 ] stack commented on HBASE-20649: --- Forgot to add a file so had to push an addendum... commit

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558356#comment-16558356 ] Hudson commented on HBASE-20649: Results for branch master [build #409 on

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556409#comment-16556409 ] Hudson commented on HBASE-20649: Results for branch branch-2 [build #1026 on

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-25 Thread Balazs Meszaros (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555345#comment-16555345 ] Balazs Meszaros commented on HBASE-20649: - [~busbey], is there anything which is missing from my

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543987#comment-16543987 ] Sean Busbey commented on HBASE-20649: - I've got this ready to go locally. FYI [~balazs.meszaros]

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543720#comment-16543720 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543356#comment-16543356 ] Sean Busbey commented on HBASE-20649: - All the failed tests are timeouts. I'll try rerunning

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543292#comment-16543292 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-13 Thread Balazs Meszaros (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542794#comment-16542794 ] Balazs Meszaros commented on HBASE-20649: - I added some extra documentation. > Validate HFiles

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-11 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540112#comment-16540112 ] Sean Busbey commented on HBASE-20649: - Yeah, the steps I listed are what I'd like to document for

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539423#comment-16539423 ] Duo Zhang commented on HBASE-20649: --- I think the tool is a good start. We can add the steps in our ref

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539329#comment-16539329 ] Zach York commented on HBASE-20649: --- Trying to get up to speed on this all. Overall looks like a handy

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538966#comment-16538966 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538864#comment-16538864 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538850#comment-16538850 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538704#comment-16538704 ] Sean Busbey commented on HBASE-20649: - what do y'all think about the outlined steps [~zyork] or

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-10 Thread Balazs Meszaros (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538429#comment-16538429 ] Balazs Meszaros commented on HBASE-20649: - Thanks for the deep testing [~busbey]. I did a rebase

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-06 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535476#comment-16535476 ] Sean Busbey commented on HBASE-20649: - okay, I think this can work. We just need to add some more

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534323#comment-16534323 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-05 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534145#comment-16534145 ] Sean Busbey commented on HBASE-20649: - Let me stand up my test cluster again and work through it

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-07-05 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534106#comment-16534106 ] Mike Drob commented on HBASE-20649: --- {code} +for (Path p : corrupted) { + LOG.warn("Corrupt

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-26 Thread Balazs Meszaros (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523435#comment-16523435 ] Balazs Meszaros commented on HBASE-20649: - I did a small modification, now it also checks the

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-21 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519570#comment-16519570 ] Peter Somogyi commented on HBASE-20649: --- Unfortunately I don't have time to continue working on

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511716#comment-16511716 ] Sean Busbey commented on HBASE-20649: - The current patch misses any hfiles in a snapshot that aren't

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511298#comment-16511298 ] Sean Busbey commented on HBASE-20649: - cursory look at patch looks great! I have a small cluster

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-13 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511197#comment-16511197 ] Peter Somogyi commented on HBASE-20649: --- I made some testing how much time it takes to check the

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511186#comment-16511186 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-13 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510900#comment-16510900 ] Peter Somogyi commented on HBASE-20649: --- v3: rebased after HBASE-20656 > Validate HFiles do not

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-11 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508223#comment-16508223 ] Mike Drob commented on HBASE-20649: --- This likely needs a rebase after HBASE-20656. Unfortunate that

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-08 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505985#comment-16505985 ] Peter Somogyi commented on HBASE-20649: --- When I tried to simply use HBCK2 against hbase-1.2

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-07 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505097#comment-16505097 ] Mike Drob commented on HBASE-20649: --- bq. HBCK uses the same utility when -checkCorruptHFiles is used

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-07 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505077#comment-16505077 ] Peter Somogyi commented on HBASE-20649: --- HFileCorruptionChecker reads the HFile Trailers so it

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-07 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504870#comment-16504870 ] Mike Drob commented on HBASE-20649: --- I'm worried about the scalability of this approach. Since we're

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-07 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504755#comment-16504755 ] Peter Somogyi commented on HBASE-20649: --- [~mdrob], [~busbey]: could you take a look? > Validate

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502716#comment-16502716 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-05 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502435#comment-16502435 ] Peter Somogyi commented on HBASE-20649: --- v2: change tab to spaces in stacktrace example >

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502393#comment-16502393 ] Hadoop QA commented on HBASE-20649: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20649) Validate HFiles do not have PREFIX_TREE DataBlockEncoding

2018-05-25 Thread Peter Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490726#comment-16490726 ] Peter Somogyi commented on HBASE-20649: --- I started to work on a MapReduce job that could go through