[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271889#comment-15271889
 ] 

ramkrishna.s.vasudevan commented on HBASE-15756:


Even the NettyRpcServer will do the read to the NettyByteBuffs and handoffs to 
the Decoder and the decoder reads the NettyByteBuff data and handoffs to the 
handlers via the queues right?
So you see more improvement in terms of NettyRpcServer because of the Netty's 
efficiency?
In terms of offheap/onheap ByteBuffers when we try to use Unsafe way of 
accessing we could see that the performance was better than netty. Hence while 
working on the offheap read path we concluded in going with nio ByteBuffers 
only. Like to know more here and should be pretty much useful too.

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-14850) C++ client implementation

2016-05-04 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271882#comment-15271882
 ] 

stack commented on HBASE-14850:
---

Today some devs had a meeting to discuss how to do one C++ client only. Notes 
from the meeting are here:

1. 
https://docs.google.com/document/d/10O626jxK6f7nmdBjG0h9f_PYkbWNMGKH0-1H1i6SmaU/edit?ts=572a3ce1#
2. https://paste.apache.org/7lCa

The announcement for the meeting on dev list was here: 
http://mail-archives.apache.org/mod_mbox/hbase-dev/201605.mbox/%3CCAMUu0w-86+Ce2S+76GSangUA0E_sfJt=ja3wzot5kyvohwg...@mail.gmail.com%3E

> C++ client implementation
> -
>
> Key: HBASE-14850
> URL: https://issues.apache.org/jira/browse/HBASE-14850
> Project: HBase
>  Issue Type: Task
>Reporter: Elliott Clark
>
> It's happening.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15609) Remove PB references from Result, DoubleColumnInterpreter and any such public facing class for 2.0

2016-05-04 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271867#comment-15271867
 ] 

ramkrishna.s.vasudevan commented on HBASE-15609:


[~saint@gmail.com]
Ping for reviews. 

> Remove PB references from Result, DoubleColumnInterpreter and any such public 
> facing class for 2.0
> --
>
> Key: HBASE-15609
> URL: https://issues.apache.org/jira/browse/HBASE-15609
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.0.0
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
>Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: HBASE-15609.patch, HBASE-15609.patch, HBASE-15609_1.patch
>
>
> This is a sub-task for HBASE-15174.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15608) Remove PB references from SnapShot related Exceptions

2016-05-04 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271866#comment-15271866
 ] 

ramkrishna.s.vasudevan commented on HBASE-15608:


[~saint@gmail.com] ping for reviews. 

> Remove PB references from SnapShot related Exceptions
> -
>
> Key: HBASE-15608
> URL: https://issues.apache.org/jira/browse/HBASE-15608
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.0.0
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
>Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: HBASE-15608.patch, HBASE-15608_1.patch
>
>
> This is a sub-task for HBASE-15174.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15575) Rename table DDL *Handler methods in MasterObserver to more meaningful names

2016-05-04 Thread Stephen Yuan Jiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stephen Yuan Jiang updated HBASE-15575:
---
Attachment: HBASE-15575.v4-master.patch

> Rename table DDL *Handler methods in MasterObserver to more meaningful names
> 
>
> Key: HBASE-15575
> URL: https://issues.apache.org/jira/browse/HBASE-15575
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Affects Versions: 2.0.0
>Reporter: Stephen Yuan Jiang
>Assignee: Stephen Yuan Jiang
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15575.v1-master.patch, 
> HBASE-15575.v2-master.patch, HBASE-15575.v3-master.patch, 
> HBASE-15575.v4-master.patch
>
>
> Procedure V2 replaced table DDL handler implementation to procedure 
> implementation.  It does not make sense to keep the *Handler methods in 
> MasterObserver.  This JIRA follows HBASE-13645 way to deprecate the existing 
> observers with *Handler and add the new observers with more meaningful names. 
>  
> One proposal that to rename the coprocessor in procedure thread with Action 
> and use Completed/Rollback to distinguish successful or failed procedures.  
> (Note: this JIRA is just for name change; the actual Rollback cp does not 
> exist today) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15755) SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked

2016-05-04 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-15755:

Attachment: HBASE-15755-v3.patch

> SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface 
> audience marked
> ---
>
> Key: HBASE-15755
> URL: https://issues.apache.org/jira/browse/HBASE-15755
> Project: HBase
>  Issue Type: Bug
>Reporter: ramkrishna.s.vasudevan
>Assignee: Matteo Bertozzi
> Attachments: HBASE-15755-v0.patch, HBASE-15755-v1.patch, 
> HBASE-15755-v2.patch, HBASE-15755-v3.patch
>
>
> SnapshotDescriptionUtils does not have any IA marked. Should this be private 
> or public?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15755) SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271855#comment-15271855
 ] 

Hadoop QA commented on HBASE-15755:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
8s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 41s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m 
39s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
16s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 
52s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 26s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 34s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 
43s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 45s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 45s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 32s 
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 19s 
{color} | {color:red} hbase-server: patch generated 1 new + 12 unchanged - 1 
fixed = 13 total (was 13) {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
15s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 8m 
27s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.1 
2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 
11s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 26s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 35s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 101m 23s 
{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 
16s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 132m 28s {color} 
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802340/HBASE-15755-v2.patch |
| JIRA Issue | HBASE-15755 |
| Optional Tests |  asflicense  javac  javadoc  unit  findbugs  hadoopcheck  
hbaseanti  checkstyle  compile  |
| uname | Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/test_framework/yetus-0.2.1/lib/precommit/personality/hbase.sh
 |
| git revision | master / d23d600 |
| Default Java | 1.7.0_79 |
| Multi-JDK versions |  /home/jenkins/tools/java/jdk1.8.0:1.8.0 
/usr/local/jenkins/java/jdk1.7.0_79:1.7.0_79 |
| findbugs | v3.0.0 |
| checkstyle | 

[jira] [Commented] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271829#comment-15271829
 ] 

Hadoop QA commented on HBASE-15767:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} patch {color} | {color:blue} 0m 1s 
{color} | {color:blue} The patch file was not named according to hbase's naming 
conventions. Please see 
https://yetus.apache.org/documentation/0.2.1/precommit-patchnames for 
instructions. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m 0s 
{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 17s 
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
31s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 32s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m 45s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 1m 
50s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 5m 30s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m 24s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 11s 
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 
20s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 57s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m 57s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 58s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m 58s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 2m 
58s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 5s 
{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 
20m 14s {color} | {color:green} Patch does not cause any errors with Hadoop 
2.4.1 2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m 36s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m 30s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 155m 35s 
{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 9m 32s 
{color} | {color:green} hbase-rest in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 175m 36s 
{color} | {color:green} root in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 1m 
10s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 422m 55s {color} 
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802276/15767.v1.txt |
| JIRA Issue | HBASE-15767 |
| Optional Tests |  asflicense  javac  javadoc  unit  xml  compile  |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 

[jira] [Commented] (HBASE-15575) Rename table DDL *Handler methods in MasterObserver to more meaningful names

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271820#comment-15271820
 ] 

Hadoop QA commented on HBASE-15575:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 6 new or modified test 
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 41s 
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m 
2s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 16s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 54s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 9m 
13s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
33s {color} | {color:green} master passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 36s 
{color} | {color:red} hbase-rsgroup in master has 7 extant Findbugs warnings. 
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 53s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 52s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 11s 
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 
3s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 17s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 17s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 51s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 51s 
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 51s 
{color} | {color:red} hbase-server: patch generated 26 new + 628 unchanged - 24 
fixed = 654 total (was 652) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 31s 
{color} | {color:red} hbase-rsgroup: patch generated 26 new + 628 unchanged - 
24 fixed = 654 total (was 652) {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
32s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 
10m 7s {color} | {color:green} Patch does not cause any errors with Hadoop 
2.4.1 2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 
13s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 51s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 48s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 123m 26s 
{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 28s 
{color} | {color:green} hbase-rsgroup in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 
28s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 174m 40s {color} 
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802316/HBASE-15575.v3-master.patch
 |
| JIRA Issue | HBASE-15575 |
| Optional Tests 

[jira] [Commented] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271811#comment-15271811
 ] 

Hadoop QA commented on HBASE-15768:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 8 new or modified test 
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 32s 
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
9s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 4s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m 5s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 11m 
30s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 2m 
16s {color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s 
{color} | {color:blue} Skipped branch modules with no Java source: . {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 13s 
{color} | {color:red} branch/hbase-it no findbugs output file 
(hbase-it/target/findbugsXml.xml) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m 41s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m 55s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 8s 
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 
0s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 13s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m 13s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m 1s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m 1s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 11m 
35s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 2m 
20s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m 
3s {color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} shelldocs {color} | {color:green} 0m 
2s {color} | {color:green} There were no new shelldocs issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 9m 
3s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.1 
2.5.2 2.6.0. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s 
{color} | {color:blue} Skipped patch modules with no Java source: . {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 17s 
{color} | {color:red} patch/hbase-it no findbugs output file 
(hbase-it/target/findbugsXml.xml) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m 47s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m 51s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 56s 
{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 15s 
{color} | {color:green} hbase-hadoop-compat in the patch passed. {color} |
| {color:green}+1{color} | {color:green} 

[jira] [Updated] (HBASE-15743) Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput

2016-05-04 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15743:
--
Attachment: HBASE-15743-v3.patch

Promote TestSaslFanOutOneBlockAsyncDFSOutput to large tests.

> Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput
> 
>
> Key: HBASE-15743
> URL: https://issues.apache.org/jira/browse/HBASE-15743
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15743-v1.patch, HBASE-15743-v2.patch, 
> HBASE-15743-v3.patch, HBASE-15743.patch
>
>
> http://hadoop.apache.org/docs/r2.6.4/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HBASE-15755) SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked

2016-05-04 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi reassigned HBASE-15755:
---

Assignee: Matteo Bertozzi  (was: ramkrishna.s.vasudevan)

> SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface 
> audience marked
> ---
>
> Key: HBASE-15755
> URL: https://issues.apache.org/jira/browse/HBASE-15755
> Project: HBase
>  Issue Type: Bug
>Reporter: ramkrishna.s.vasudevan
>Assignee: Matteo Bertozzi
> Attachments: HBASE-15755-v0.patch, HBASE-15755-v1.patch, 
> HBASE-15755-v2.patch
>
>
> SnapshotDescriptionUtils does not have any IA marked. Should this be private 
> or public?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15755) SnapshotDescriptionUtils does not have any Interface audience marked

2016-05-04 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-15755:

Attachment: HBASE-15755-v2.patch

> SnapshotDescriptionUtils does not have any Interface audience marked
> 
>
> Key: HBASE-15755
> URL: https://issues.apache.org/jira/browse/HBASE-15755
> Project: HBase
>  Issue Type: Bug
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Attachments: HBASE-15755-v0.patch, HBASE-15755-v1.patch, 
> HBASE-15755-v2.patch
>
>
> SnapshotDescriptionUtils does not have any IA marked. Should this be private 
> or public?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15755) SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked

2016-05-04 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-15755:

Summary: SnapshotDescriptionUtils and SnapshotTestingUtils do not have any 
Interface audience marked  (was: SnapshotDescriptionUtils does not have any 
Interface audience marked)

> SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface 
> audience marked
> ---
>
> Key: HBASE-15755
> URL: https://issues.apache.org/jira/browse/HBASE-15755
> Project: HBase
>  Issue Type: Bug
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Attachments: HBASE-15755-v0.patch, HBASE-15755-v1.patch, 
> HBASE-15755-v2.patch
>
>
> SnapshotDescriptionUtils does not have any IA marked. Should this be private 
> or public?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15743) Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput

2016-05-04 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271790#comment-15271790
 ] 

Duo Zhang commented on HBASE-15743:
---

{quote}
nit: consider making TestSaslFanOutOneBlockAsyncDFSOutput large test - it took 
114 seconds on Jenkins.
{quote}
Oh yes, it has 36 tests now...

> Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput
> 
>
> Key: HBASE-15743
> URL: https://issues.apache.org/jira/browse/HBASE-15743
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15743-v1.patch, HBASE-15743-v2.patch, 
> HBASE-15743.patch
>
>
> http://hadoop.apache.org/docs/r2.6.4/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15743) Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput

2016-05-04 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271779#comment-15271779
 ] 

Ted Yu commented on HBASE-15743:


Gone through the patch which looks fine to me.

nit: consider making TestSaslFanOutOneBlockAsyncDFSOutput large test - it took 
114 seconds on Jenkins.

> Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput
> 
>
> Key: HBASE-15743
> URL: https://issues.apache.org/jira/browse/HBASE-15743
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15743-v1.patch, HBASE-15743-v2.patch, 
> HBASE-15743.patch
>
>
> http://hadoop.apache.org/docs/r2.6.4/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15655) Set up doxygen for documentation

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271768#comment-15271768
 ] 

Hadoop QA commented on HBASE-15655:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 4s {color} 
| {color:red} HBASE-15655 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/0.2.1/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802331/HBASE-15655.patch |
| JIRA Issue | HBASE-15655 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1770/console |
| Powered by | Apache Yetus 0.2.1   http://yetus.apache.org |


This message was automatically generated.



> Set up doxygen for documentation
> 
>
> Key: HBASE-15655
> URL: https://issues.apache.org/jira/browse/HBASE-15655
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15655.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15655) Set up doxygen for documentation

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15655:
--
Status: Patch Available  (was: Open)

> Set up doxygen for documentation
> 
>
> Key: HBASE-15655
> URL: https://issues.apache.org/jira/browse/HBASE-15655
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15655.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15655) Set up doxygen for documentation

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15655:
--
Attachment: HBASE-15655.patch

https://reviews.facebook.net/D57663

> Set up doxygen for documentation
> 
>
> Key: HBASE-15655
> URL: https://issues.apache.org/jira/browse/HBASE-15655
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15655.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread binlijin (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271750#comment-15271750
 ] 

binlijin commented on HBASE-15756:
--

Use Netty, we can keep the scheduling Queues, we still have Scheduling's 
advantage 
(http://blog.cloudera.com/blog/2014/12/new-in-cdh-5-2-improvements-for-running-multiple-workloads-on-a-single-hbase-cluster/).
 

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread binlijin (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271732#comment-15271732
 ] 

binlijin commented on HBASE-15756:
--

So if we can make the RpcServer pluggable, and if we do not want to have 
HTTP/2, so can we use the NettyRpcServer?
If we want the HTTP/2, we can use the current RpcServer?

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread binlijin (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271731#comment-15271731
 ] 

binlijin commented on HBASE-15756:
--

[~andrew.purt...@gmail.com], i have a question with the thrift client, i find 
the thrift client is not thread safe, and so the connection can not share by 
multiple thread?
And i also test thrift with yscb and find it is not better as netty.

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15575) Rename table DDL *Handler methods in MasterObserver to more meaningful names

2016-05-04 Thread Stephen Yuan Jiang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271725#comment-15271725
 ] 

Stephen Yuan Jiang commented on HBASE-15575:


this JIRA just changes current existing coprocessor.  The rollback coprocessor 
change would be in a different JIRA.

> Rename table DDL *Handler methods in MasterObserver to more meaningful names
> 
>
> Key: HBASE-15575
> URL: https://issues.apache.org/jira/browse/HBASE-15575
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Affects Versions: 2.0.0
>Reporter: Stephen Yuan Jiang
>Assignee: Stephen Yuan Jiang
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15575.v1-master.patch, 
> HBASE-15575.v2-master.patch, HBASE-15575.v3-master.patch
>
>
> Procedure V2 replaced table DDL handler implementation to procedure 
> implementation.  It does not make sense to keep the *Handler methods in 
> MasterObserver.  This JIRA follows HBASE-13645 way to deprecate the existing 
> observers with *Handler and add the new observers with more meaningful names. 
>  
> One proposal that to rename the coprocessor in procedure thread with Action 
> and use Completed/Rollback to distinguish successful or failed procedures.  
> (Note: this JIRA is just for name change; the actual Rollback cp does not 
> exist today) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread binlijin (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271727#comment-15271727
 ] 

binlijin commented on HBASE-15756:
--

I also test the situation: Readers read ByteBuffer data, and handoff to 
Decoders, Decoders decode the ByteBuffer data to Call and then handoff to 
Handlers via scheduling Queues, and i find this will have 10% improvements and 
not as better as NettyRpcServer. 

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15766) Show working puts

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271721#comment-15271721
 ] 

Hadoop QA commented on HBASE-15766:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 5s {color} 
| {color:red} HBASE-15766 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/0.2.1/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802321/HBASE-15766-v4.patch |
| JIRA Issue | HBASE-15766 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1769/console |
| Powered by | Apache Yetus 0.2.1   http://yetus.apache.org |


This message was automatically generated.



> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766-v3.patch, HBASE-15766-v4.patch, HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271718#comment-15271718
 ] 

Hudson commented on HBASE-15613:


FAILURE: Integrated in HBase-1.1-JDK8 #1796 (See 
[https://builds.apache.org/job/HBase-1.1-JDK8/1796/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
bf6109a2a77e43bacdf6c44965774461c34e6d4f)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15766) Show working puts

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15766:
--
Attachment: HBASE-15766-v4.patch

> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766-v3.patch, HBASE-15766-v4.patch, HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HBASE-15655) Set up doxygen for documentation

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark reassigned HBASE-15655:
-

Assignee: Elliott Clark

> Set up doxygen for documentation
> 
>
> Key: HBASE-15655
> URL: https://issues.apache.org/jira/browse/HBASE-15655
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271704#comment-15271704
 ] 

Hudson commented on HBASE-15613:


FAILURE: Integrated in HBase-1.1-JDK7 #1710 (See 
[https://builds.apache.org/job/HBase-1.1-JDK7/1710/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
bf6109a2a77e43bacdf6c44965774461c34e6d4f)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15743) Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput

2016-05-04 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271700#comment-15271700
 ] 

Duo Zhang commented on HBASE-15743:
---

[~stack] What do you think of the newest patch? It adds the support for hdfs 
2.4.x and 2.5.x. I have upload it to review board.

[~tedyu] Is this what you want? In the UT, I create a encryption zone directory 
and write a file under it and then read it using the original InputStream 
provided by DistributedFileSystem.

Thanks.

> Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput
> 
>
> Key: HBASE-15743
> URL: https://issues.apache.org/jira/browse/HBASE-15743
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15743-v1.patch, HBASE-15743-v2.patch, 
> HBASE-15743.patch
>
>
> http://hadoop.apache.org/docs/r2.6.4/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-8458) Support for batch version of checkAndPut() and checkAndDelete()

2016-05-04 Thread Babar Tareen (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271683#comment-15271683
 ] 

Babar Tareen commented on HBASE-8458:
-

I implemented compare and set functionality for apache phoenix based on the 
exclusive locking and coprocessors 
(https://github.com/babartareen/phoenix/blob/master/phoenix-core/src/main/java/org/apache/phoenix/hbase/index/Indexer.java#L295).
 With recent change to using ReadWriteLock, a coprocessor will no longer have 
exclusive control over a row and thus won't be the correct place to intercept a 
row update. CheckAndPut  can not be called from the coprocessor as locks are 
already acquired as @Esther noted. Where might be a better place to intercept 
an update and be able to allow/skip it?

> Support for batch version of checkAndPut() and checkAndDelete()
> ---
>
> Key: HBASE-8458
> URL: https://issues.apache.org/jira/browse/HBASE-8458
> Project: HBase
>  Issue Type: Improvement
>  Components: Client, regionserver
>Affects Versions: 0.95.0
>Reporter: Hari Mankude
>
> The use case is that the user has multiple threads loading hundreds of keys 
> into a hbase table. Occasionally there are collisions in the keys being 
> uploaded by different threads. So for correctness, it is required to do 
> checkAndPut() instead of a put(). However, doing a checkAndPut() rpc for 
> every key update is non optimal. It would be good to have a batch version of 
> checkAndPut() similar to batch put(). The client can partition the keys on 
> region boundaries.
> The jira is NOT looking for any type of cross-row locking or multi-row 
> atomicity with checkAndPut()
> Batch version of checkAndDelete() is a similar requirement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271676#comment-15271676
 ] 

Hudson commented on HBASE-15613:


FAILURE: Integrated in HBase-Trunk_matrix #894 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/894/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
29eb3e8bccb1dcea3cd39c055e175b21b4d33a26)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15575) Rename table DDL *Handler methods in MasterObserver to more meaningful names

2016-05-04 Thread Matteo Bertozzi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271679#comment-15271679
 ] 

Matteo Bertozzi commented on HBASE-15575:
-

Skimmed v3, it looks good but I don't see the rollback methods. will those get 
in a different jira or did you find a reason we should not have a rollback 
coproc call?

> Rename table DDL *Handler methods in MasterObserver to more meaningful names
> 
>
> Key: HBASE-15575
> URL: https://issues.apache.org/jira/browse/HBASE-15575
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Affects Versions: 2.0.0
>Reporter: Stephen Yuan Jiang
>Assignee: Stephen Yuan Jiang
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15575.v1-master.patch, 
> HBASE-15575.v2-master.patch, HBASE-15575.v3-master.patch
>
>
> Procedure V2 replaced table DDL handler implementation to procedure 
> implementation.  It does not make sense to keep the *Handler methods in 
> MasterObserver.  This JIRA follows HBASE-13645 way to deprecate the existing 
> observers with *Handler and add the new observers with more meaningful names. 
>  
> One proposal that to rename the coprocessor in procedure thread with Action 
> and use Completed/Rollback to distinguish successful or failed procedures.  
> (Note: this JIRA is just for name change; the actual Rollback cp does not 
> exist today) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271677#comment-15271677
 ] 

Hudson commented on HBASE-15741:


FAILURE: Integrated in HBase-Trunk_matrix #894 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/894/])
HBASE-15741 Provide backward compatibility for HBase coprocessor service 
(garyh: rev d23d600d768cd73125d5be62b7b8e3fa6fac5761)
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionServerCoprocessorRpcChannel.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/protobuf/generated/DummyRegionServerEndpointProtos.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCoprocessorRpcUtils.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcUtils.java
* hbase-server/src/test/protobuf/DummyRegionServerEndpoint.proto
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java


> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> 

[jira] [Commented] (HBASE-15729) Remove old JDiff wrapper scripts in dev-support

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271675#comment-15271675
 ] 

Hudson commented on HBASE-15729:


FAILURE: Integrated in HBase-Trunk_matrix #894 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/894/])
HBASE-15729 Remove old JDiff wrapper scripts in dev-support (busbey: rev 
fa9fdfee2d94c94cc67e7129a0ff5edef5e5f69b)
* dev-support/jdiffHBasePublicAPI_common.sh
* dev-support/hbase_jdiff_afterSingularityTemplate.xml
* dev-support/hbase_jdiff_acrossSingularityTemplate.xml
* dev-support/hbase_jdiff_template.xml
* dev-support/jdiffHBasePublicAPI.sh


> Remove old JDiff wrapper scripts in dev-support
> ---
>
> Key: HBASE-15729
> URL: https://issues.apache.org/jira/browse/HBASE-15729
> Project: HBase
>  Issue Type: Task
>  Components: build, community
>Reporter: Dima Spivak
>Assignee: Dima Spivak
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15729.patch
>
>
> Since HBASE-12808, we've been using the Java API Compliance Checker instead 
> of JDiff to look at API compatibility. Probably makes sense to remove the old 
> wrapper scripts that aren't being used anymore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15752) ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job

2016-05-04 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-15752:
---
Fix Version/s: 0.98.20

> ClassNotFoundException is encountered when custom WAL codec is not found in 
> WALPlayer job
> -
>
> Key: HBASE-15752
> URL: https://issues.apache.org/jira/browse/HBASE-15752
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Assignee: Ted Yu
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: 15752.v1.patch, 15752.v2.patch
>
>
> [~cartershanklin] reported the following when he tried out back / restore 
> feature in a Phoenix enabled deployment:
> {code}
> 2016-05-02 18:57:58,578 FATAL [IPC Server handler 2 on 38194] 
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
> attempt_1462215011294_0001_m_00_0 - exited : java.io. IOException: Cannot 
> get log reader
>   at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:344)
>   at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:266)
>   at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:254)
>   at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:403)
>   at 
> org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.initialize(WALInputFormat.java:152)
>   at 
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1708)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
> Caused by: java.lang.UnsupportedOperationException: Unable to find 
> org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec
>   at 
> org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:36)
>   at 
> org.apache.hadoop.hbase.regionserver.wal.WALCellCodec.create(WALCellCodec.java:103)
>   at 
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.getCodec(ProtobufLogReader.java:282)
>   at 
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initAfterCompression(ProtobufLogReader.java:292)
>   at 
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:82)
>   at 
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:149)
>   at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:301)
>   ... 12 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   at java.lang.Class.forName0(Native Method)
>   at java.lang.Class.forName(Class.java:264)
> {code}
> This was due to the IndexedWALEditCodec (specified thru 
> hbase.regionserver.wal.codec) used by Phoenix being absent in hadoop 
> classpath.
> WALPlayer should handle this situation better by adding the jar for 
> IndexedWALEditCodec class to mapreduce job dependency.
> Although this was found during testing of backup / restore, the error may 
> occur in other places where WALPlayer needs custom WAL codec for the replay.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15575) Rename table DDL *Handler methods in MasterObserver to more meaningful names

2016-05-04 Thread Stephen Yuan Jiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stephen Yuan Jiang updated HBASE-15575:
---
Attachment: HBASE-15575.v3-master.patch

> Rename table DDL *Handler methods in MasterObserver to more meaningful names
> 
>
> Key: HBASE-15575
> URL: https://issues.apache.org/jira/browse/HBASE-15575
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Affects Versions: 2.0.0
>Reporter: Stephen Yuan Jiang
>Assignee: Stephen Yuan Jiang
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15575.v1-master.patch, 
> HBASE-15575.v2-master.patch, HBASE-15575.v3-master.patch
>
>
> Procedure V2 replaced table DDL handler implementation to procedure 
> implementation.  It does not make sense to keep the *Handler methods in 
> MasterObserver.  This JIRA follows HBASE-13645 way to deprecate the existing 
> observers with *Handler and add the new observers with more meaningful names. 
>  
> One proposal that to rename the coprocessor in procedure thread with Action 
> and use Completed/Rollback to distinguish successful or failed procedures.  
> (Note: this JIRA is just for name change; the actual Rollback cp does not 
> exist today) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15766) Show working puts

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271653#comment-15271653
 ] 

Hadoop QA commented on HBASE-15766:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 4s {color} 
| {color:red} HBASE-15766 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/0.2.1/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802304/HBASE-15766-v3.patch |
| JIRA Issue | HBASE-15766 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1767/console |
| Powered by | Apache Yetus 0.2.1   http://yetus.apache.org |


This message was automatically generated.



> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766-v3.patch, HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271643#comment-15271643
 ] 

Hadoop QA commented on HBASE-14920:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} rubocop {color} | {color:blue} 0m 0s 
{color} | {color:blue} rubocop was not available. {color} |
| {color:blue}0{color} | {color:blue} ruby-lint {color} | {color:blue} 0m 0s 
{color} | {color:blue} Ruby-lint was not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 10 new or modified test 
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 13s 
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
26s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 55s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 28s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 7m 
25s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 1m 
0s {color} | {color:green} master passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 18s 
{color} | {color:red} branch/hbase-it no findbugs output file 
(hbase-it/target/findbugsXml.xml) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 32s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 11s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s 
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 
44s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 46s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 46s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 23s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 23s 
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 2m 6s 
{color} | {color:red} hbase-client: patch generated 1 new + 49 unchanged - 1 
fixed = 50 total (was 50) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 43s 
{color} | {color:red} hbase-server: patch generated 1 new + 49 unchanged - 1 
fixed = 50 total (was 50) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 39s 
{color} | {color:red} hbase-shell: patch generated 1 new + 49 unchanged - 1 
fixed = 50 total (was 50) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 44s 
{color} | {color:red} hbase-it: patch generated 1 new + 49 unchanged - 1 fixed 
= 50 total (was 50) {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
57s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 9m 
22s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.1 
2.5.2 2.6.0. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 18s 
{color} | {color:red} patch/hbase-it no findbugs output file 
(hbase-it/target/findbugsXml.xml) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 27s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 15s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit 

[jira] [Created] (HBASE-15770) Stop using wangle's global executor

2016-05-04 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-15770:
-

 Summary: Stop using wangle's global executor
 Key: HBASE-15770
 URL: https://issues.apache.org/jira/browse/HBASE-15770
 Project: HBase
  Issue Type: Sub-task
Reporter: Elliott Clark


In order to ensure that all things are closed correctly, we need to call 
IOThreadPool#close. Doing that on the singleton is pretty bad manners. So we 
should just use our own IOThreadPool and not use the global one at all.

This will involve making the client have the threads.
Passing the threads to connection pool, connection factory, etc.
Calling close on the threads when cleaning up the client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271633#comment-15271633
 ] 

Hudson commented on HBASE-15741:


FAILURE: Integrated in HBase-1.3-IT #648 (See 
[https://builds.apache.org/job/HBase-1.3-IT/648/])
HBASE-15741 Provide backward compatibility for HBase coprocessor service 
(garyh: rev 06847c9e31a426e4a0672a00c308f7785417da1f)
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcUtils.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCoprocessorRpcUtils.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionServerCoprocessorRpcChannel.java
* hbase-server/src/test/protobuf/DummyRegionServerEndpoint.proto
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/protobuf/generated/DummyRegionServerEndpointProtos.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java


> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> 

[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271632#comment-15271632
 ] 

Hudson commented on HBASE-15613:


FAILURE: Integrated in HBase-1.3-IT #648 (See 
[https://builds.apache.org/job/HBase-1.3-IT/648/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
5cf25c5a51ac3cc1a46a202d11ef50be6d24e335)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271618#comment-15271618
 ] 

Hudson commented on HBASE-15613:


SUCCESS: Integrated in HBase-1.4 #136 (See 
[https://builds.apache.org/job/HBase-1.4/136/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
12da71b82414da5ec7f60b127b6124ce016f5127)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271619#comment-15271619
 ] 

Hudson commented on HBASE-15741:


SUCCESS: Integrated in HBase-1.4 #136 (See 
[https://builds.apache.org/job/HBase-1.4/136/])
HBASE-15741 Provide backward compatibility for HBase coprocessor service 
(garyh: rev b36222831d1c39f4825f56bd802b30e497cb829f)
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/protobuf/generated/DummyRegionServerEndpointProtos.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
* hbase-server/src/test/protobuf/DummyRegionServerEndpoint.proto
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCoprocessorRpcUtils.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionServerCoprocessorRpcChannel.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcUtils.java


> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> 

[jira] [Commented] (HBASE-9393) Hbase does not closing a closed socket resulting in many CLOSE_WAIT

2016-05-04 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271615#comment-15271615
 ] 

Ted Yu commented on HBASE-9393:
---

[~busbey]:
What do you think of Ashish's response ?

> Hbase does not closing a closed socket resulting in many CLOSE_WAIT 
> 
>
> Key: HBASE-9393
> URL: https://issues.apache.org/jira/browse/HBASE-9393
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 0.94.2, 0.98.0, 1.0.1.1, 1.1.2
> Environment: Centos 6.4 - 7 regionservers/datanodes, 8 TB per node, 
> 7279 regions
>Reporter: Avi Zrachya
>Assignee: Ashish Singhi
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-9393.patch, HBASE-9393.v1.patch, 
> HBASE-9393.v10.patch, HBASE-9393.v11.patch, HBASE-9393.v12.patch, 
> HBASE-9393.v13.patch, HBASE-9393.v14.patch, HBASE-9393.v15.patch, 
> HBASE-9393.v15.patch, HBASE-9393.v2.patch, HBASE-9393.v3.patch, 
> HBASE-9393.v4.patch, HBASE-9393.v5.patch, HBASE-9393.v5.patch, 
> HBASE-9393.v5.patch, HBASE-9393.v6.patch, HBASE-9393.v6.patch, 
> HBASE-9393.v6.patch, HBASE-9393.v7.patch, HBASE-9393.v8.patch, 
> HBASE-9393.v9.patch
>
>
> HBase dose not close a dead connection with the datanode.
> This resulting in over 60K CLOSE_WAIT and at some point HBase can not connect 
> to the datanode because too many mapped sockets from one host to another on 
> the same port.
> The example below is with low CLOSE_WAIT count because we had to restart 
> hbase to solve the porblem, later in time it will incease to 60-100K sockets 
> on CLOSE_WAIT
> [root@hd2-region3 ~]# netstat -nap |grep CLOSE_WAIT |grep 21592 |wc -l
> 13156
> [root@hd2-region3 ~]# ps -ef |grep 21592
> root 17255 17219  0 12:26 pts/000:00:00 grep 21592
> hbase21592 1 17 Aug29 ?03:29:06 
> /usr/java/jdk1.6.0_26/bin/java -XX:OnOutOfMemoryError=kill -9 %p -Xmx8000m 
> -ea -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode 
> -Dhbase.log.dir=/var/log/hbase 
> -Dhbase.log.file=hbase-hbase-regionserver-hd2-region3.swnet.corp.log ...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15766) Show working puts

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15766:
--
Attachment: HBASE-15766-v3.patch

> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766-v3.patch, HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15686) Add override mechanism for the exempt classes when dynamically loading table coprocessor

2016-05-04 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-15686:
---
Fix Version/s: 0.98.20

> Add override mechanism for the exempt classes when dynamically loading table 
> coprocessor
> 
>
> Key: HBASE-15686
> URL: https://issues.apache.org/jira/browse/HBASE-15686
> Project: HBase
>  Issue Type: Improvement
>  Components: Coprocessors
>Affects Versions: 1.0.1
>Reporter: Sangjin Lee
>Assignee: Ted Yu
> Fix For: 2.0.0, 1.4.0, 0.98.20
>
> Attachments: 15686.v2.txt, 15686.v3.txt, 15686.v4.txt, 15686.v5.txt, 
> 15686.v6.txt, 15686.wip
>
>
> As part of Hadoop's Timeline Service v.2 (YARN-2928), we're adding a table 
> coprocessor (YARN-4062). However, we're finding that the coprocessor cannot 
> be loaded dynamically. A relevant snippet for the exception:
> {noformat}
> java.io.IOException: Class 
> org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor 
> cannot be loaded
> at 
> org.apache.hadoop.hbase.master.HMaster.sanityCheckTableDescriptor(HMaster.java:1329)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1269)
> at 
> org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:398)
> at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:42436)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.IOException: Class 
> org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor 
> cannot be loaded
> at 
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.testTableCoprocessorAttrs(RegionCoprocessorHost.java:324)
> at 
> org.apache.hadoop.hbase.master.HMaster.checkClassLoading(HMaster.java:1483)
> at 
> org.apache.hadoop.hbase.master.HMaster.sanityCheckTableDescriptor(HMaster.java:1327)
> ... 8 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at 
> org.apache.hadoop.hbase.util.CoprocessorClassLoader.loadClass(CoprocessorClassLoader.java:275)
> at 
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.testTableCoprocessorAttrs(RegionCoprocessorHost.java:322)
> ... 10 more
> {noformat}
> We tracked it down to the fact that {{CoprocessorClassLoader}} regarding all 
> hadoop classes as exempt from loading from the coprocessor jar. Since our 
> coprocessor sits in the coprocessor jar, and yet the loading of this class is 
> delegated to the parent which does not have this jar, the classloading fails.
> What would be nice is the ability to exclude certain classes from the exempt 
> classes so that they can be loaded via table coprocessor classloader. See 
> hadoop's {{ApplicationClassLoader}} for a similar feature.
> Is there any other way to load this coprocessor at the table scope?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-15769) Perform validation on cluster key for add_peer

2016-05-04 Thread Ted Yu (JIRA)
Ted Yu created HBASE-15769:
--

 Summary: Perform validation on cluster key for add_peer
 Key: HBASE-15769
 URL: https://issues.apache.org/jira/browse/HBASE-15769
 Project: HBase
  Issue Type: Bug
Reporter: Ted Yu
Priority: Minor


[~pateljaymin] reported the following.

In hbase cluster, adding a peer for replication, incorrectly defined zookeeper 
znode does not fail new peer creation. However, replication breaks down.

For example, 
below string incorrectly defines zookeeper znode as "hbase" instead of 
"/hbase"...
{code}
> add_peer '1', "host1.com,host2.com,host3.com:2181:hbase
{code}
This left replication broken, even after we dropped and added a new correct 
entry for the peer.

It wasn't until we bounced the cluster that the issue was fixed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15764) Builtin help for "hbase backup" doesn't recognize the subcommand

2016-05-04 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-15764:
---
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Thanks for the review, Enis.

> Builtin help for "hbase backup" doesn't recognize the subcommand
> 
>
> Key: HBASE-15764
> URL: https://issues.apache.org/jira/browse/HBASE-15764
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Assignee: Ted Yu
>  Labels: backup
> Attachments: 15764.v1.patch
>
>
> [~cartershanklin] reported this problem.
> No arguments:
> {code}
> [vagrant@hdp250-hbase ~]$ hbase backup set
> 2016-05-03 23:08:25,999 ERROR [main] util.AbstractHBaseTool: Error running 
> command-line tool
> java.io.IOException: command line format
>   at 
> org.apache.hadoop.hbase.backup.impl.BackupCommands$BackupSetCommand.execute(BackupCommands.java:453)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:107)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:122)
>   at 
> org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112)
>   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:127)
> {code}
> Wrong guess:
> {code}
> [vagrant@hdp250-hbase ~]$ hbase backup set create
> 2016-05-03 23:08:29,210 ERROR [main] util.AbstractHBaseTool: Error running 
> command-line tool
> java.io.IOException: Unknown command for 'set' :create
>   at 
> org.apache.hadoop.hbase.backup.impl.BackupCommands$BackupSetCommand.getCommand(BackupCommands.java:555)
>   at 
> org.apache.hadoop.hbase.backup.impl.BackupCommands$BackupSetCommand.execute(BackupCommands.java:457)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:107)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:122)
>   at 
> org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112)
>   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
>   at 
> org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:127)
> {code}
> Incomplete arguments:
> {code}
> [vagrant@hdp250-hbase ~]$ hbase backup set add
> ERROR: Wrong args
> {code}
> This was caused by miscalculation in the offset of the command line argument 
> user is seeking help on.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271557#comment-15271557
 ] 

Hudson commented on HBASE-15613:


SUCCESS: Integrated in HBase-1.2 #618 (See 
[https://builds.apache.org/job/HBase-1.2/618/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
6df94a81ca24797f4761e8284a55c75fbc6287b5)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271549#comment-15271549
 ] 

Hudson commented on HBASE-15741:


SUCCESS: Integrated in HBase-1.3 #684 (See 
[https://builds.apache.org/job/HBase-1.3/684/])
HBASE-15741 Provide backward compatibility for HBase coprocessor service 
(garyh: rev 06847c9e31a426e4a0672a00c308f7785417da1f)
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCoprocessorRpcUtils.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/protobuf/generated/DummyRegionServerEndpointProtos.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcUtils.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionServerCoprocessorRpcChannel.java
* hbase-server/src/test/protobuf/DummyRegionServerEndpoint.proto
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java


> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> 

[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271548#comment-15271548
 ] 

Hudson commented on HBASE-15613:


SUCCESS: Integrated in HBase-1.3 #684 (See 
[https://builds.apache.org/job/HBase-1.3/684/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
5cf25c5a51ac3cc1a46a202d11ef50be6d24e335)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15600) Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271542#comment-15271542
 ] 

Hadoop QA commented on HBASE-15600:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
57s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 39s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 5m 
21s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
18s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 
38s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 43s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 49s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 
59s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 2s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 2s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 46s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 46s 
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 44s 
{color} | {color:red} hbase-server: patch generated 1 new + 217 unchanged - 1 
fixed = 218 total (was 218) {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
19s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 
11m 55s {color} | {color:green} Patch does not cause any errors with Hadoop 
2.4.1 2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 
10s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 1s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 42s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 147m 52s 
{color} | {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 
19s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 188m 53s {color} 
| {color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | 
hadoop.hbase.io.asyncfs.TestSaslFanOutOneBlockAsyncDFSOutput |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802262/hbase-15600_v6.patch |
| JIRA Issue | HBASE-15600 |
| Optional Tests |  asflicense  javac  javadoc  unit  findbugs  hadoopcheck  
hbaseanti  checkstyle  compile  |
| uname | Linux asf910.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/test_framework/yetus-0.2.1/lib/precommit/personality/hbase.sh
 |
| git revision | master / 29eb3e8 |
| Default Java | 1.7.0_79 |
| Multi-JDK versions |  /home/jenkins/tools/java/jdk1.8.0:1.8.0 

[jira] [Comment Edited] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271493#comment-15271493
 ] 

Sean Busbey edited comment on HBASE-15768 at 5/4/16 9:49 PM:
-

+1 pending no surprises from buildbot.


was (Author: busbey):
+1 pending now surprises from buildbot.

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Assignee: Alex Moundalexis
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271493#comment-15271493
 ] 

Sean Busbey commented on HBASE-15768:
-

+1 pending now surprises from buildbot.

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Assignee: Alex Moundalexis
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15768:

Fix Version/s: 2.0.0

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Assignee: Alex Moundalexis
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Mikhail Antonov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-15741:

Summary: Provide backward compatibility for HBase coprocessor service names 
 (was: TokenProvider coprocessor RPC incompatibile between 1.2 and 1.3)

> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:108)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at 
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:340)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:108)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.addTokenForJob(TokenUtil.java:329)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initCredentials(TableMapReduceUtil.java:490)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:209)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:162)
> at 
> 

[jira] [Commented] (HBASE-15741) Provide backward compatibility for HBase coprocessor service names

2016-05-04 Thread Mikhail Antonov (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271488#comment-15271488
 ] 

Mikhail Antonov commented on HBASE-15741:
-

Thanks!

(renamed jira to match commit message for easy matching)

> Provide backward compatibility for HBase coprocessor service names
> --
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:108)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at 
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:340)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:108)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.addTokenForJob(TokenUtil.java:329)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initCredentials(TableMapReduceUtil.java:490)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:209)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:162)
> at 
> 

[jira] [Updated] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15768:

Assignee: Alex Moundalexis

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Assignee: Alex Moundalexis
>Priority: Trivial
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15415) Improve Master WebUI snapshot information

2016-05-04 Thread huaxiang sun (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271428#comment-15271428
 ] 

huaxiang sun commented on HBASE-15415:
--

Thanks [~busbey]. Here is the link to the review request.

https://reviews.apache.org/r/46993/

> Improve Master WebUI snapshot information
> -
>
> Key: HBASE-15415
> URL: https://issues.apache.org/jira/browse/HBASE-15415
> Project: HBase
>  Issue Type: Improvement
>  Components: master, snapshots
>Affects Versions: 0.94.0
>Reporter: Sean Busbey
>Assignee: huaxiang sun
>Priority: Minor
>  Labels: beginner, supportability
> Fix For: 2.0.0, 1.3.0, 0.98.20
>
> Attachments: 1-snapshot.png, 2-snapshots.png, HBASE-15415-v001.patch, 
> HBASE-15415-v002.patch, HBASE-15415-v003.patch, empty-snapshots.png, 
> master-snapshot.png
>
>
> On the Master WebUI, we currently show lots of information about the space 
> used by individual snapshots.
> We should also give a total space used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Alex Moundalexis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Moundalexis updated HBASE-15768:
-
Attachment: HBASE-15768.v0.patch

Patch submitted.

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Priority: Trivial
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Alex Moundalexis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Moundalexis updated HBASE-15768:
-
Status: Patch Available  (was: Open)

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Priority: Trivial
> Attachments: HBASE-15768.v0.patch
>
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15707) ImportTSV bulk output does not support tags with hfile.format.version=3

2016-05-04 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-15707:
---
Fix Version/s: 0.98.20

> ImportTSV bulk output does not support tags with hfile.format.version=3
> ---
>
> Key: HBASE-15707
> URL: https://issues.apache.org/jira/browse/HBASE-15707
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2, 1.0.5
>Reporter: huaxiang sun
>Assignee: huaxiang sun
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: HBASE-15707-branch-1_v001.patch, HBASE-15707-v001.patch, 
> HBASE-15707-v002.patch
>
>
> Running the following command:
> {code}
> hbase hbase org.apache.hadoop.hbase.mapreduce.ImportTsv \ 
> -Dhfile.format.version=3 \ 
> -Dmapreduce.map.combine.minspills=1 \ 
> -Dimporttsv.separator=, \ 
> -Dimporttsv.skip.bad.lines=false \ 
> -Dimporttsv.columns="HBASE_ROW_KEY,cf1:a,HBASE_CELL_TTL" \ 
> -Dimporttsv.bulk.output=/tmp/testttl/output/1 \ 
> testttl \ 
> /tmp/testttl/input 
> {code}
> The content of input is like:
> {code}
> row1,data1,0060 
> row2,data2,0660 
> row3,data3,0060 
> row4,data4,0660
> {code}
> When running hfile tool with the output hfile, there is no ttl tag.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15768) fix capitalization of ZooKeeper usage

2016-05-04 Thread Alex Moundalexis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Moundalexis updated HBASE-15768:
-
Summary: fix capitalization of ZooKeeper usage  (was: fix capitalization of 
ZooKeeper usage throughout)

> fix capitalization of ZooKeeper usage
> -
>
> Key: HBASE-15768
> URL: https://issues.apache.org/jira/browse/HBASE-15768
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Alex Moundalexis
>Priority: Trivial
>
> Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
> figured I'd fix mentions of "Zookeeper" that appear throughout the codebase 
> and documentation.
> Ignoring camelcase function names, focused primarily on visible errors, logs, 
> comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-15768) fix capitalization of ZooKeeper usage throughout

2016-05-04 Thread Alex Moundalexis (JIRA)
Alex Moundalexis created HBASE-15768:


 Summary: fix capitalization of ZooKeeper usage throughout
 Key: HBASE-15768
 URL: https://issues.apache.org/jira/browse/HBASE-15768
 Project: HBase
  Issue Type: Improvement
  Components: documentation
Reporter: Alex Moundalexis
Priority: Trivial


Apache ZooKeeper is a proper name ([ref|https://zookeeper.apache.org/]), 
figured I'd fix mentions of "Zookeeper" that appear throughout the codebase and 
documentation.

Ignoring camelcase function names, focused primarily on visible errors, logs, 
comments, and UI strings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-05-04 Thread Eshcar Hillel (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271382#comment-15271382
 ] 

Eshcar Hillel commented on HBASE-14920:
---

A core property of the new in-memory flush and compaction is retaining data in 
memory for longer time. In the majority of cases flush to disk is invoked to 
reduce memory usage. In less frequent use cases the user wish to clear the 
memory.
If we only consider the second case and flush the entire content to disk with 
every flush request, we significantly weaken the feature strength. 
Alternatively, we can have this feature well documented, so that user 
understand that if they wish to clear the memory they may need to invoke flush 
several times.

Actually the same can happen for a default memstore.
Consider the case where while a flush to disk is in progress the user invokes a 
flush to clear memory. However when the user flush is executed it finds the 
snapshot segment still has entries -- it only logs a warning and ignores the 
user flush request. So in this case as well a user request is not satisfied, 
and the user should be able to handle this.

> Compacting Memstore
> ---
>
> Key: HBASE-14920
> URL: https://issues.apache.org/jira/browse/HBASE-14920
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Eshcar Hillel
>Assignee: Eshcar Hillel
> Attachments: HBASE-14920-V01.patch, HBASE-14920-V02.patch, 
> HBASE-14920-V03.patch, HBASE-14920-V04.patch, HBASE-14920-V05.patch, 
> HBASE-14920-V06.patch, HBASE-14920-V07.patch, move.to.junit4.patch
>
>
> Implementation of a new compacting memstore with non-optimized immutable 
> segment representation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-14920) Compacting Memstore

2016-05-04 Thread Eshcar Hillel (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eshcar Hillel updated HBASE-14920:
--
Attachment: HBASE-14920-V07.patch

> Compacting Memstore
> ---
>
> Key: HBASE-14920
> URL: https://issues.apache.org/jira/browse/HBASE-14920
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Eshcar Hillel
>Assignee: Eshcar Hillel
> Attachments: HBASE-14920-V01.patch, HBASE-14920-V02.patch, 
> HBASE-14920-V03.patch, HBASE-14920-V04.patch, HBASE-14920-V05.patch, 
> HBASE-14920-V06.patch, HBASE-14920-V07.patch, move.to.junit4.patch
>
>
> Implementation of a new compacting memstore with non-optimized immutable 
> segment representation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271374#comment-15271374
 ] 

Hudson commented on HBASE-15613:


SUCCESS: Integrated in HBase-1.2-IT #499 (See 
[https://builds.apache.org/job/HBase-1.2-IT/499/])
HBASE-15613 TestNamespaceCommand times out (enis: rev 
6df94a81ca24797f4761e8284a55c75fbc6287b5)
* hbase-server/src/test/resources/hbase-site.xml


> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15760) TestBlockEvictionFromClient#testParallelGetsAndScanWithWrappedRegionScanner fails in master branch

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271367#comment-15271367
 ] 

Hudson commented on HBASE-15760:


FAILURE: Integrated in HBase-Trunk_matrix #893 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/893/])
HBASE-15760 (ramkrishna: rev 809ed326f0f39698c9ee7ed8847440ba89e0f5ce)
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestBlockEvictionFromClient.java


> TestBlockEvictionFromClient#testParallelGetsAndScanWithWrappedRegionScanner 
> fails in master branch
> --
>
> Key: HBASE-15760
> URL: https://issues.apache.org/jira/browse/HBASE-15760
> Project: HBase
>  Issue Type: Test
>Reporter: Ted Yu
>Assignee: ramkrishna.s.vasudevan
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15760.patch
>
>
> The following test failure can be reproduced locally:
> {code}
> java.lang.AssertionError: expected:<6> but was:<3>
>   at org.junit.Assert.fail(Assert.java:88)
>   at org.junit.Assert.failNotEquals(Assert.java:834)
>   at org.junit.Assert.assertEquals(Assert.java:645)
>   at org.junit.Assert.assertEquals(Assert.java:631)
>   at 
> org.apache.hadoop.hbase.client.TestBlockEvictionFromClient.checkForBlockEviction(TestBlockEvictionFromClient.java:1329)
>   at 
> org.apache.hadoop.hbase.client.TestBlockEvictionFromClient.testParallelGetsAndScanWithWrappedRegionScanner(TestBlockEvictionFromClient.java:833)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15763) Isolate Wal related stuff from MasterFileSystem

2016-05-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271366#comment-15271366
 ] 

Hudson commented on HBASE-15763:


FAILURE: Integrated in HBase-Trunk_matrix #893 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/893/])
HBASE-15763 Isolate Wal related stuff from MasterFileSystem (matteo.bertozzi: 
rev a8a2c516a0752ff782f8338502c8b2005049eda3)
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockNoopMasterServices.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitor.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterWalManager.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFileSystem.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterServices.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java


> Isolate Wal related stuff from MasterFileSystem
> ---
>
> Key: HBASE-15763
> URL: https://issues.apache.org/jira/browse/HBASE-15763
> Project: HBase
>  Issue Type: Sub-task
>  Components: master, wal
>Affects Versions: 2.0.0
>Reporter: Matteo Bertozzi
>Assignee: Matteo Bertozzi
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-15763-v0.patch, HBASE-15763-v1.patch, 
> HBASE-15763-v2.patch
>
>
> To help the work on the redofs (HBASE-14090) we need some rework on the 
> "filesystem" interfaces.
> This task just moves the WAL related things out of MasterFileSystem.
> This task is not meant to create a good interface for the wal but just to 
> move out things from MasterFileSystem to be able to start working on that. 
> the fixup of the wal interface will be done later in another jira. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15766) Show working puts

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271362#comment-15271362
 ] 

Hadoop QA commented on HBASE-15766:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 5s {color} 
| {color:red} HBASE-15766 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/0.2.1/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802261/HBASE-15766-v2.patch |
| JIRA Issue | HBASE-15766 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1763/console |
| Powered by | Apache Yetus 0.2.1   http://yetus.apache.org |


This message was automatically generated.



> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15761) Add on more server name tests

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271359#comment-15271359
 ] 

Hadoop QA commented on HBASE-15761:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 4s {color} 
| {color:red} HBASE-15761 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/0.2.1/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802266/HBASE-15761.patch |
| JIRA Issue | HBASE-15761 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1762/console |
| Powered by | Apache Yetus 0.2.1   http://yetus.apache.org |


This message was automatically generated.



> Add on more server name tests
> -
>
> Key: HBASE-15761
> URL: https://issues.apache.org/jira/browse/HBASE-15761
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15761.patch
>
>
> Just one test probably isn't good enough. Lets add on lots more.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15759) RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint

2016-05-04 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271357#comment-15271357
 ] 

Ted Yu commented on HBASE-15759:


Test failures don't seem to be related to the patch.

> RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint
> 
>
> Key: HBASE-15759
> URL: https://issues.apache.org/jira/browse/HBASE-15759
> Project: HBase
>  Issue Type: Improvement
>  Components: Coprocessors
>Reporter: Marek Srank
>Assignee: Ted Yu
>Priority: Minor
>  Labels: coprocessors
> Fix For: 2.0.0
>
> Attachments: 15759.v1.patch, 15759.v2.patch, 15759.v3.patch
>
>
> RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint. 
> This is crucial e.g. when creating a new StoreScanner.
> Although it is possible to obtain the readpoint via following workaround:
> ((HStore)store).getHRegion().getReadpoint(IsolationLevel.READ_COMMITTED)
> ...it presumes some knowledge of HBase internals and is not a clear option 
> for user.
> The problem was introduced in HBASE-9754, where readpoint was introduced as 
> an argument to StoreScanner constructor, but wasn't passed to the 
> preStoreScannerOpen() hook in HStore.getScanner().
> In our case it led to bug, when we were incorrectly using smallestReadpoint() 
> instead, which made coprocessor missing data in some cases [1].
> __
> [1] 
> http://mail-archives.apache.org/mod_mbox/hbase-dev/201604.mbox/%3CCAOUjMkwptCGacQ0d-4yOinDVBT%2Bbi2NOZee0fSbq%2Bk1R6V4-aw%40mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15751) Fixed HBase compilation failure with Zookeeper 3.5 and bumped HBase to use zookeeper 3.5

2016-05-04 Thread Sumeetkumar Maru (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271350#comment-15271350
 ] 

Sumeetkumar Maru commented on HBASE-15751:
--

Experienced HBase developers [~busbey]][~apurtell] [~warwithin]: What do you 
guys think is the best way to approach this one? 

> Fixed HBase compilation failure with Zookeeper 3.5 and bumped HBase to use 
> zookeeper 3.5
> 
>
> Key: HBASE-15751
> URL: https://issues.apache.org/jira/browse/HBASE-15751
> Project: HBase
>  Issue Type: Task
>  Components: Zookeeper
>Affects Versions: master
>Reporter: Yufeng Jiang
>Priority: Minor
> Fix For: master
>
> Attachments: HBASE-15751.patch
>
>
> From zookeeper 3.5 and onwards, runFromConfig(QuorumPeerConfig config) method 
> throws AdminServerException.
> HBase uses runFromConfig in HQuorumPeer.java and hence needs to throw this 
> exception as well.
> I've created a patch to make HBase compatible with zookeeper-3.5.1-alpha. 
> However, since zookeeper 3.5+ does not have a stable version yet, I don't 
> think we should commit this patch. Instead, I suggest using this JIRA to 
> track this issue. Once zookeeper releases stable version of 3.5+, I could 
> create another patch to bump the zookeeper version in HBase trunk.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15759) RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271347#comment-15271347
 ] 

Hadoop QA commented on HBASE-15759:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 2 new or modified test 
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 
16s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 39s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m 
47s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
15s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 
59s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 28s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 35s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 
47s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 45s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 45s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 36s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 36s 
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 20s 
{color} | {color:red} hbase-server: patch generated 2 new + 316 unchanged - 2 
fixed = 318 total (was 318) {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
15s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 8m 
51s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.1 
2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 
14s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 27s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 34s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 97m 20s {color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 
15s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 129m 21s {color} 
| {color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.security.access.TestNamespaceCommands |
| Timed out junit tests | 
org.apache.hadoop.hbase.zookeeper.lock.TestZKInterProcessReadWriteLock |
|   | org.apache.hadoop.hbase.namespace.TestNamespaceAuditor |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802246/15759.v3.patch |
| JIRA Issue | HBASE-15759 |
| Optional Tests |  asflicense  javac  javadoc  unit  findbugs  hadoopcheck  
hbaseanti  checkstyle  compile  |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/test_framework/yetus-0.2.1/lib/precommit/personality/hbase.sh
 |
| git revision | 

[jira] [Commented] (HBASE-15617) Canary in regionserver mode might not enumerate all regionservers

2016-05-04 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271333#comment-15271333
 ] 

Hadoop QA commented on HBASE-15617:
---

| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 
0s {color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s 
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 
0s {color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 
49s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 47s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m 
35s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
14s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 
53s {color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 26s 
{color} | {color:green} master passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 32s 
{color} | {color:green} master passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 
42s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 48s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 48s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 32s 
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m 
39s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 
15s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 8m 
27s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.1 
2.5.2 2.6.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 
10s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 26s 
{color} | {color:green} the patch passed with JDK v1.8.0 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 33s 
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 109m 34s 
{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 
14s {color} | {color:green} Patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 140m 38s {color} 
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12802243/HBASE-15617-v1.patch |
| JIRA Issue | HBASE-15617 |
| Optional Tests |  asflicense  javac  javadoc  unit  findbugs  hadoopcheck  
hbaseanti  checkstyle  compile  |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/test_framework/yetus-0.2.1/lib/precommit/personality/hbase.sh
 |
| git revision | master / 809ed32 |
| Default Java | 1.7.0_79 |
| Multi-JDK versions |  /home/jenkins/tools/java/jdk1.8.0:1.8.0 
/usr/local/jenkins/java/jdk1.7.0_79:1.7.0_79 |
| findbugs | v3.0.0 |
|  Test Results | 
https://builds.apache.org/job/PreCommit-HBASE-Build/1758/testReport/ |
| modules | C: hbase-server U: 

[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271327#comment-15271327
 ] 

stack commented on HBASE-15756:
---

The argument for Netty could be the built-in features it has that we don't have 
in our hadoop-derived RPC: e.g. HTTP/2 support.

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15756) Pluggable RpcServer

2016-05-04 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271325#comment-15271325
 ] 

stack commented on HBASE-15756:
---

I forgot to say, yeah, justify why we should do netty instead of what we 
currently have. It seems like you've started in on that.

I've been doing some perf work trying to get our random read throughput up. 
Currently I've been focused on the handoff from Socket/Listener to Readers and 
then via scheduling Queues to Handlers. If I have the Handler doing the read of 
the request, I can double throughput (IIRC). How you think Netty improves stuff 
in here [~aoxiang]? Thanks.

> Pluggable RpcServer
> ---
>
> Key: HBASE-15756
> URL: https://issues.apache.org/jira/browse/HBASE-15756
> Project: HBase
>  Issue Type: Improvement
>Reporter: binlijin
>Assignee: binlijin
>
> Current we use a simple RpcServer, and can not configure and use other 
> implementation.This issue is to make the RpcServer pluggable, so we can make 
> other implementation for example netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15741) TokenProvider coprocessor RPC incompatibile between 1.2 and 1.3

2016-05-04 Thread Gary Helmling (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gary Helmling updated HBASE-15741:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Pushed to branch-1.3+.  Thanks for review [~mantonov]!

> TokenProvider coprocessor RPC incompatibile between 1.2 and 1.3
> ---
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:108)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at 
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:340)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:108)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.addTokenForJob(TokenUtil.java:329)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initCredentials(TableMapReduceUtil.java:490)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:209)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:162)
> at 
> 

[jira] [Updated] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-15767:
---
Assignee: Ted Yu
  Status: Patch Available  (was: Open)

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
>Assignee: Ted Yu
> Fix For: 2.0.0
>
> Attachments: 15767.v1.txt
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-15767:
---
Attachment: 15767.v1.txt

Ran \*Http\* tests locally which passed.

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
> Fix For: 2.0.0
>
> Attachments: 15767.v1.txt
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15741) TokenProvider coprocessor RPC incompatibile between 1.2 and 1.3

2016-05-04 Thread Gary Helmling (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gary Helmling updated HBASE-15741:
--
Attachment: HBASE-15741.004.patch

Trivial changes -- add a test category and make checkstyle happy.

> TokenProvider coprocessor RPC incompatibile between 1.2 and 1.3
> ---
>
> Key: HBASE-15741
> URL: https://issues.apache.org/jira/browse/HBASE-15741
> Project: HBase
>  Issue Type: Bug
>  Components: Coprocessors
>Affects Versions: 1.3.0
>Reporter: Gary Helmling
>Assignee: Gary Helmling
>Priority: Blocker
> Fix For: 1.3.0
>
> Attachments: HBASE-15741.001.patch, HBASE-15741.002.patch, 
> HBASE-15741.003.patch, HBASE-15741.004.patch
>
>
> Attempting to run a map reduce job with a 1.3 client on a secure cluster 
> running 1.2 is failing when making the coprocessor rpc to obtain a delegation 
> token:
> {noformat}
> Exception in thread "main" 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: 
> org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No registered 
> coprocessor service found for name hbase.pb.AuthenticationService in region 
> hbase:meta,,1
> at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7741)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1988)
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1970)
> at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
> at java.lang.Thread.run(Thread.java:745)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1631)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
> at 
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:108)
> at 
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callBlockingMethod(CoprocessorRpcChannel.java:73)
> at 
> org.apache.hadoop.hbase.protobuf.generated.AuthenticationProtos$AuthenticationService$BlockingStub.getAuthenticationToken(AuthenticationProtos.java:4512)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:86)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:111)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil$1.run(TokenUtil.java:108)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at 
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:340)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainToken(TokenUtil.java:108)
> at 
> org.apache.hadoop.hbase.security.token.TokenUtil.addTokenForJob(TokenUtil.java:329)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initCredentials(TableMapReduceUtil.java:490)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:209)
> at 
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:162)
> at 
> 

[jira] [Updated] (HBASE-15761) Add on more server name tests

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15761:
--
Status: Patch Available  (was: Open)

> Add on more server name tests
> -
>
> Key: HBASE-15761
> URL: https://issues.apache.org/jira/browse/HBASE-15761
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15761.patch
>
>
> Just one test probably isn't good enough. Lets add on lots more.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15766) Show working puts

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15766:
--
Status: Patch Available  (was: Open)

> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15761) Add on more server name tests

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15761:
--
Attachment: HBASE-15761.patch

https://reviews.facebook.net/D57609

> Add on more server name tests
> -
>
> Key: HBASE-15761
> URL: https://issues.apache.org/jira/browse/HBASE-15761
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15761.patch
>
>
> Just one test probably isn't good enough. Lets add on lots more.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15613) TestNamespaceCommand times out

2016-05-04 Thread Enis Soztutar (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enis Soztutar updated HBASE-15613:
--
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 1.2.2
   1.1.5
   1.4.0
   1.3.0
   2.0.0
   Status: Resolved  (was: Patch Available)

Committed this. Thanks for reviews. 

> TestNamespaceCommand times out
> --
>
> Key: HBASE-15613
> URL: https://issues.apache.org/jira/browse/HBASE-15613
> Project: HBase
>  Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.1.5, 1.2.2
>
> Attachments: hbase-15613.patch
>
>
> We think that the root cause maybe HBASE-15295. Will inspect more. 
> See
> https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15600) Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks

2016-05-04 Thread Enis Soztutar (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enis Soztutar updated HBASE-15600:
--
Attachment: hbase-15600_v6.patch

> Add provision for adding mutations to memstore or able to write to same 
> region in batchMutate coprocessor hooks
> ---
>
> Key: HBASE-15600
> URL: https://issues.apache.org/jira/browse/HBASE-15600
> Project: HBase
>  Issue Type: Improvement
>Reporter: Rajeshbabu Chintaguntla
>Assignee: Rajeshbabu Chintaguntla
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: HBASE-15600.patch, HBASE-15600_v1.patch, 
> HBASE-15600_v2.patch, hbase-15600_v3.patch, hbase-15600_v4.patch, 
> hbase-15600_v5.patch, hbase-15600_v6.patch
>
>
> As part of PHOENIX-1734 we need to write the index updates to same region 
> from coprocessors but writing from batchMutate API is not allowed because of 
> mvcc. 
> Raised PHOENIX-2742 to discuss any alternative way to write to the same 
> region directly or not but not having any proper solution there.
> Currently we have provision to write wal edits from coprocessors. We can set 
> wal edits in MiniBatchOperationInProgress.
> {noformat}
>   /**
>* Sets the walEdit for the operation(Mutation) at the specified position.
>* @param index
>* @param walEdit
>*/
>   public void setWalEdit(int index, WALEdit walEdit) {
> this.walEditsFromCoprocessors[getAbsoluteIndex(index)] = walEdit;
>   }
> {noformat}
> Similarly we can allow to write mutations from coprocessors to memstore as 
> well. Or else we should provide the batch mutation API allow write in batch 
> mutate coprocessors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15600) Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks

2016-05-04 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271196#comment-15271196
 ] 

Enis Soztutar commented on HBASE-15600:
---

bq. Better take this miniBatchOp.getOperationsFromCoprocessors(i - firstIndex) 
into a local variable and use that.. Else there is always a chance to miss one 
place 
Good catch. Addressed in v6. 
bq. If the other jira can committed 1st, we can change here to use 
getRowLockInternal?
{{get rowLock()}} in this case is better since these are Mutations coming from 
the CP. It is not clear the CP will only give Mutations that fall in the region 
boundaries, so we should opt for the safe approach. 


> Add provision for adding mutations to memstore or able to write to same 
> region in batchMutate coprocessor hooks
> ---
>
> Key: HBASE-15600
> URL: https://issues.apache.org/jira/browse/HBASE-15600
> Project: HBase
>  Issue Type: Improvement
>Reporter: Rajeshbabu Chintaguntla
>Assignee: Rajeshbabu Chintaguntla
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: HBASE-15600.patch, HBASE-15600_v1.patch, 
> HBASE-15600_v2.patch, hbase-15600_v3.patch, hbase-15600_v4.patch, 
> hbase-15600_v5.patch
>
>
> As part of PHOENIX-1734 we need to write the index updates to same region 
> from coprocessors but writing from batchMutate API is not allowed because of 
> mvcc. 
> Raised PHOENIX-2742 to discuss any alternative way to write to the same 
> region directly or not but not having any proper solution there.
> Currently we have provision to write wal edits from coprocessors. We can set 
> wal edits in MiniBatchOperationInProgress.
> {noformat}
>   /**
>* Sets the walEdit for the operation(Mutation) at the specified position.
>* @param index
>* @param walEdit
>*/
>   public void setWalEdit(int index, WALEdit walEdit) {
> this.walEditsFromCoprocessors[getAbsoluteIndex(index)] = walEdit;
>   }
> {noformat}
> Similarly we can allow to write mutations from coprocessors to memstore as 
> well. Or else we should provide the batch mutation API allow write in batch 
> mutate coprocessors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15634) TestDateTieredCompactionPolicy#negativeForMajor is flaky

2016-05-04 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-15634:
---
Fix Version/s: 0.98.20

> TestDateTieredCompactionPolicy#negativeForMajor is flaky
> 
>
> Key: HBASE-15634
> URL: https://issues.apache.org/jira/browse/HBASE-15634
> Project: HBase
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.4.0
>Reporter: Ted Yu
>Assignee: Duo Zhang
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: 15634.v1.patch, 15634.v2.patch, 15634.v3.patch, 
> HBASE-15634.patch
>
>
> https://builds.apache.org/job/PreCommit-HBASE-Build/1365/artifact/patchprocess/patch-unit-hbase-server.txt
>  :
> {code}
> negativeForMajor(org.apache.hadoop.hbase.regionserver.TestDateTieredCompactionPolicy)
>   Time elapsed: 0.48 sec  <<< FAILURE!
> java.lang.AssertionError: expected: but was:
>   at org.junit.Assert.fail(Assert.java:88)
>   at org.junit.Assert.failNotEquals(Assert.java:834)
>   at org.junit.Assert.assertEquals(Assert.java:118)
>   at org.junit.Assert.assertEquals(Assert.java:144)
>   at 
> org.apache.hadoop.hbase.regionserver.TestDateTieredCompactionPolicy.compactEquals(TestDateTieredCompactionPolicy.java:94)
>   at 
> org.apache.hadoop.hbase.regionserver.TestDateTieredCompactionPolicy.negativeForMajor(TestDateTieredCompactionPolicy.java:301)
> {code}
> Similar test failure occurred in master JDK 8 build as well 
> (https://builds.apache.org/job/HBase-TRUNK_matrix/839/jdk=latest1.8,label=yahoo-not-h2/testReport/org.apache.hadoop.hbase.regionserver/TestDateTieredCompactionPolicy/negativeForMajor/).
> Since TestDateTieredCompactionPolicy is a small test, its failure prevented 
> large tests from running.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15766) Show working puts

2016-05-04 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark updated HBASE-15766:
--
Attachment: HBASE-15766-v2.patch

https://reviews.facebook.net/D57603

> Show working puts
> -
>
> Key: HBASE-15766
> URL: https://issues.apache.org/jira/browse/HBASE-15766
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Elliott Clark
>Assignee: Elliott Clark
> Attachments: HBASE-15766-v1.patch, HBASE-15766-v2.patch, 
> HBASE-15766.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15710) Include issue servers information in RetriesExhaustedWithDetailsException message

2016-05-04 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-15710:
---
Fix Version/s: 0.98.20

> Include issue servers information in RetriesExhaustedWithDetailsException 
> message
> -
>
> Key: HBASE-15710
> URL: https://issues.apache.org/jira/browse/HBASE-15710
> Project: HBase
>  Issue Type: Bug
>Reporter: Yu Li
>Assignee: Yu Li
>Priority: Minor
> Fix For: 2.0.0, 1.3.0, 1.4.0, 0.98.20
>
> Attachments: HBASE-15710.patch
>
>
> In current {{RetriesExhaustedWithDetailsException#getDesc}}, we have 
> constructed a StringBuilder to add information of issue servers but returned 
> the wrong string:
> {code}
>   public static String getDesc(List exceptions,
>List actions,
>List hostnamePort) {
> String s = getDesc(classifyExs(exceptions));
> StringBuilder addrs = new StringBuilder(s);
> addrs.append("servers with issues: ");
> Set uniqAddr = new HashSet();
> uniqAddr.addAll(hostnamePort);
> for(String addr : uniqAddr) {
>   addrs.append(addr).append(", ");
> }
> return s;
>   }
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271170#comment-15271170
 ] 

Sean Busbey commented on HBASE-15767:
-

Can we get an umbrella for dependency updates for 2.0? I'd like to get us off 
of Jetty 6 and JRuby 1.6, just off the top of my head.

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
> Fix For: 2.0.0
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15767:

Component/s: dependencies
 build

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
> Fix For: 2.0.0
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15767:

Issue Type: Improvement  (was: Bug)

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
> Fix For: 2.0.0
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15415) Improve Master WebUI snapshot information

2016-05-04 Thread huaxiang sun (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271168#comment-15271168
 ] 

huaxiang sun commented on HBASE-15415:
--

I am going to put the diff to the review board.

> Improve Master WebUI snapshot information
> -
>
> Key: HBASE-15415
> URL: https://issues.apache.org/jira/browse/HBASE-15415
> Project: HBase
>  Issue Type: Improvement
>  Components: master, snapshots
>Affects Versions: 0.94.0
>Reporter: Sean Busbey
>Assignee: huaxiang sun
>Priority: Minor
>  Labels: beginner, supportability
> Fix For: 2.0.0, 1.3.0, 0.98.20
>
> Attachments: 1-snapshot.png, 2-snapshots.png, HBASE-15415-v001.patch, 
> HBASE-15415-v002.patch, HBASE-15415-v003.patch, empty-snapshots.png, 
> master-snapshot.png
>
>
> On the Master WebUI, we currently show lots of information about the space 
> used by individual snapshots.
> We should also give a total space used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15767) Upgrade httpclient dependency

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15767:

Fix Version/s: 2.0.0

> Upgrade httpclient dependency
> -
>
> Key: HBASE-15767
> URL: https://issues.apache.org/jira/browse/HBASE-15767
> Project: HBase
>  Issue Type: Improvement
>  Components: build, dependencies
>Reporter: Ted Yu
> Fix For: 2.0.0
>
>
> Currently commons-httpclient 3.1 is used.
> This is already end-of-life by apache.
> We should move to 4.3.6 or later.
> Details:
> https://issues.apache.org/jira/browse/HADOOP-12767
> https://issues.apache.org/jira/browse/HADOOP-10105
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-5262 : 
> http/conn/ssl/SSLConnectionSocketFactory.java in Apache HttpComponents 
> HttpClient before 4.3.6 ignores the http. socket.timeout configuration 
> setting during an SSL handshake, which allows remote attackers to cause a 
> denial of service (HTTPS call hang) via unspecified vectors.
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-6153
> https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2012-5783
> Apache Commons HttpClient 3.x, as used in Amazon Flexible Payments Service 
> (FPS) merchant Java SDK and other products, does not verify that the server 
> hostname matches a domain  name in the subject's Common Name (CN) or 
> subjectAltName field of the X.509 certificate, which allows man-in-the-middle 
> attackers to spoof SSL servers via an arbitrary valid certificate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15415) Improve Master WebUI snapshot information

2016-05-04 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271165#comment-15271165
 ] 

Sean Busbey commented on HBASE-15415:
-

I'm +1 pending buildbot.

> Improve Master WebUI snapshot information
> -
>
> Key: HBASE-15415
> URL: https://issues.apache.org/jira/browse/HBASE-15415
> Project: HBase
>  Issue Type: Improvement
>  Components: master, snapshots
>Affects Versions: 0.94.0
>Reporter: Sean Busbey
>Assignee: huaxiang sun
>Priority: Minor
>  Labels: beginner, supportability
> Fix For: 2.0.0, 1.3.0, 0.98.20
>
> Attachments: 1-snapshot.png, 2-snapshots.png, HBASE-15415-v001.patch, 
> HBASE-15415-v002.patch, HBASE-15415-v003.patch, empty-snapshots.png, 
> master-snapshot.png
>
>
> On the Master WebUI, we currently show lots of information about the space 
> used by individual snapshots.
> We should also give a total space used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-15765) RPC handlers should steal from other queues in the same or higher priority

2016-05-04 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271154#comment-15271154
 ] 

Enis Soztutar commented on HBASE-15765:
---

bq. Can you be a bit more specific? So high priority pools could borrow 
handlers from low(er) priority pools? But not the other way, right? Or else 
we'd need preemption to avoid problems with priority inversion.
Yes. We always want to reserve the high priority handlers to be accepting only 
high priority requests. Normal priority handlers though should be able to 
handle requests from the higher priority queues if they are available. Even 
within the same priority level, we do sharding of queues, so if a Call ends up 
in one shard, the handlers for the other shard cannot process those.  

> RPC handlers should steal from other queues in the same or higher priority
> --
>
> Key: HBASE-15765
> URL: https://issues.apache.org/jira/browse/HBASE-15765
> Project: HBase
>  Issue Type: Improvement
>Reporter: Enis Soztutar
>
> With the simple rpc scheduler model by default, a request first falls in one 
> type of queue (priority, general, replication) and it will get "sharded" in a 
> queue within that priority level (for example there are 2 queues for the high 
> priority level). The handlers can only take from their specific queues, and 
> nothing else. 
> Even if a request is waiting in a high priority queue, the handlers within 
> the same priority level or a lower priority level will not see these requests 
> (which is the root cause for HBASE-15613). We should be able to steal from 
> other queues, without losing the prioritization and sharding benefits. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15729) Remove old JDiff wrapper scripts in dev-support

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15729:

   Resolution: Fixed
Fix Version/s: 2.0.0
   Status: Resolved  (was: Patch Available)

Pushed to master. Thanks!

> Remove old JDiff wrapper scripts in dev-support
> ---
>
> Key: HBASE-15729
> URL: https://issues.apache.org/jira/browse/HBASE-15729
> Project: HBase
>  Issue Type: Task
>  Components: build, community
>Reporter: Dima Spivak
>Assignee: Dima Spivak
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15729.patch
>
>
> Since HBASE-12808, we've been using the Java API Compliance Checker instead 
> of JDiff to look at API compatibility. Probably makes sense to remove the old 
> wrapper scripts that aren't being used anymore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-15729) Remove old JDiff wrapper scripts in dev-support

2016-05-04 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15729:

Component/s: community
 build

> Remove old JDiff wrapper scripts in dev-support
> ---
>
> Key: HBASE-15729
> URL: https://issues.apache.org/jira/browse/HBASE-15729
> Project: HBase
>  Issue Type: Task
>  Components: build, community
>Reporter: Dima Spivak
>Assignee: Dima Spivak
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-15729.patch
>
>
> Since HBASE-12808, we've been using the Java API Compliance Checker instead 
> of JDiff to look at API compatibility. Probably makes sense to remove the old 
> wrapper scripts that aren't being used anymore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


  1   2   >