Re: CI and IT tests

2016-11-22 Thread Jonathan Hsieh
I think I fixed the HBase-Trunk-IT job -- it had the same problem the other matrix jobs had. It used "slaves" instead of "label expression" to select the Hadoop group of machines. Here's a build that hsa gotten machiens and is making progress:

[jira] [Created] (HBASE-17168) Use a cell as the start point of a scan internally

2016-11-22 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-17168: - Summary: Use a cell as the start point of a scan internally Key: HBASE-17168 URL: https://issues.apache.org/jira/browse/HBASE-17168 Project: HBase Issue Type:

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-22 Thread Yu Li
Thanks Andrew, actually a blog is coming soon (smile). And I've opened HBASE-17138 for the backport-to-branch-1 discussion, FWIW. Best Regards, Yu On 22 November 2016 at 22:13, Andrew Purtell wrote: > > I hope we

[jira] [Created] (HBASE-17167) Pass mvcc to client when scan

2016-11-22 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-17167: - Summary: Pass mvcc to client when scan Key: HBASE-17167 URL: https://issues.apache.org/jira/browse/HBASE-17167 Project: HBase Issue Type: Sub-task

[jira] [Reopened] (HBASE-17160) Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell

2016-11-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HBASE-17160: --- Reopen for addendum that does more cleanup > Undo unnecessary inter-module dependency; spark to hbase-it and

[jira] [Resolved] (HBASE-16476) Remove HLogKey

2016-11-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-16476. --- Resolution: Duplicate Resolve as duplicated with HBASE-17132. > Remove HLogKey > -- > >

CI and IT tests

2016-11-22 Thread Stack
Currently our IT tests are stuck looking for labels that no longer exist: https://builds.apache.org/view/H-L/view/HBase/job/HBase-Trunk-IT. I'm stumped because I can't see how to edit the elements of the matrix to change the slaves they use. Pointer appreciated. Thanks. Here is what I see in

[jira] [Created] (HBASE-17166) ITBLL fails on master unable to find hbase-protocol-shaded content

2016-11-22 Thread stack (JIRA)
stack created HBASE-17166: - Summary: ITBLL fails on master unable to find hbase-protocol-shaded content Key: HBASE-17166 URL: https://issues.apache.org/jira/browse/HBASE-17166 Project: HBase Issue

[jira] [Created] (HBASE-17165) Add retry to LoadIncrementalHFiles tool

2016-11-22 Thread Mike Grimes (JIRA)
Mike Grimes created HBASE-17165: --- Summary: Add retry to LoadIncrementalHFiles tool Key: HBASE-17165 URL: https://issues.apache.org/jira/browse/HBASE-17165 Project: HBase Issue Type:

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-11-22 Thread Vladimir Rodionov
>> and/or he answered most of the review feedback No, questions are still open, but I do not see any blockers and we have HBASE-16940 to address these questions. On Tue, Nov 22, 2016 at 3:04 PM, Devaraj Das wrote: > Hi Stack, hats off to you for spending so much time on

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-11-22 Thread Devaraj Das
Hi Stack, hats off to you for spending so much time on this! Thanks! From my understanding, Vlad has raised follow-up jiras for the issues you raised, and/or he answered most of the review feedback. So, do you think we could do a merge vote now? Devaraj.

[jira] [Resolved] (HBASE-17156) Restore usage command output formatting is off

2016-11-22 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov resolved HBASE-17156. --- Resolution: Fixed Resolved in HBASE-17134 > Restore usage command output formatting

Re: HBASE 2.0 release progress

2016-11-22 Thread Francis Liu
> I suspect this feature will be considered risky but I'd be willing to try it > out and give it some production-like load (and with chaos). By the time we > would be iterating our platform on 2.0 we'd have the type of production loads > fielded that could overpressure meta on a single server. 

[jira] [Created] (HBASE-17163) Refactor ExportSnapshot, SnapshotInfo and remove FS references from it

2016-11-22 Thread Umesh Agashe (JIRA)
Umesh Agashe created HBASE-17163: Summary: Refactor ExportSnapshot, SnapshotInfo and remove FS references from it Key: HBASE-17163 URL: https://issues.apache.org/jira/browse/HBASE-17163 Project:

[jira] [Created] (HBASE-17164) Move FileLink and HFileLink classes to fs.legacy package

2016-11-22 Thread Umesh Agashe (JIRA)
Umesh Agashe created HBASE-17164: Summary: Move FileLink and HFileLink classes to fs.legacy package Key: HBASE-17164 URL: https://issues.apache.org/jira/browse/HBASE-17164 Project: HBase

[jira] [Resolved] (HBASE-17145) Backport HBASE-6721 "RegionServer Group based Assignment" fixes to 1.1.x

2016-11-22 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk resolved HBASE-17145. -- Resolution: Won't Fix > Backport HBASE-6721 "RegionServer Group based Assignment" fixes to

[jira] [Created] (HBASE-17162) Avoid unconditional call to getXXXArray() in write path

2016-11-22 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-17162: -- Summary: Avoid unconditional call to getXXXArray() in write path Key: HBASE-17162 URL: https://issues.apache.org/jira/browse/HBASE-17162 Project: HBase

[jira] [Created] (HBASE-17161) MOB : Make ref cell creation more efficient

2016-11-22 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-17161: -- Summary: MOB : Make ref cell creation more efficient Key: HBASE-17161 URL: https://issues.apache.org/jira/browse/HBASE-17161 Project: HBase Issue Type:

[jira] [Created] (HBASE-17160) Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell

2016-11-22 Thread stack (JIRA)
stack created HBASE-17160: - Summary: Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell Key: HBASE-17160 URL: https://issues.apache.org/jira/browse/HBASE-17160 Project: HBase

Re: HBASE 2.0 release progress

2016-11-22 Thread Andrew Purtell
Thanks. Are your experiences with FNv2 in production documented? Perhaps on the JIRA? That would go a long way. > On Nov 22, 2016, at 12:44 PM, Thiruvel Thirumoolan > wrote: > > Hi Andrew, > > Thanks for your comments. > > FN v2 happened due to the same reasons

Re: HBASE 2.0 release progress

2016-11-22 Thread Thiruvel Thirumoolan
Hi Andrew, Thanks for your comments. FN v2 happened due to the same reasons you mention. We believe v2 is complete based on our experience using and operating it in production since early 2016. We have a design doc @ umbrella jira HBASE-15531 and have responded to all questions we had so far.

Re: HBASE 2.0 release progress

2016-11-22 Thread Andrew Purtell
I suspect this feature will be considered risky but I'd be willing to try it out and give it some production-like load (and with chaos). By the time we would be iterating our platform on 2.0 we'd have the type of production loads fielded that could overpressure meta on a single server. > On

Re: HBASE 2.0 release progress

2016-11-22 Thread Andrew Purtell
Favored nodes version 1 did not see much adoption and was hard to use or unusable, depending on who you ask, so please expect a focus on usability and feature completeness when/if v2 is reviewed for possible inclusion in 2.0. While I am not suggesting this is the case, if the v2 candidate

Still Failing: HBase Generate Website

2016-11-22 Thread Apache Jenkins Server
Build status: Still Failing If successful, the website and docs have been generated. To update the live site, follow the instructions below. If failed, skip to the bottom of this email. Use the following commands to download the patch and apply it to a clean branch based on origin/asf-site.

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-22 Thread Andrew Purtell
> I hope we could strengthen our faith in HBase capability Us too. Would you be interested in taking the metrics and discussion of them that came out in this thread into a post for the HBase project blog (https://blogs.apache.org/hbase)? As you can see from the other blog entries details about

[jira] [Created] (HBASE-17159) Better the Assignment plan when server aborted or creating tables, etc.

2016-11-22 Thread Charlie Qiangeng Xu (JIRA)
Charlie Qiangeng Xu created HBASE-17159: --- Summary: Better the Assignment plan when server aborted or creating tables, etc. Key: HBASE-17159 URL: https://issues.apache.org/jira/browse/HBASE-17159

[jira] [Created] (HBASE-17158) Avoid lock leak caused by HRegion#doDelta

2016-11-22 Thread ChiaPing Tsai (JIRA)
ChiaPing Tsai created HBASE-17158: - Summary: Avoid lock leak caused by HRegion#doDelta Key: HBASE-17158 URL: https://issues.apache.org/jira/browse/HBASE-17158 Project: HBase Issue Type: Bug