[jira] [Updated] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

LinseyPang updated HBASE-11542:
---

Status: Open  (was: Patch Available)

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

LinseyPang updated HBASE-11542:
---

Attachment: hbase11542-0.99-v3.patch

I created patch again and applied on local branch which is from master. It 
works on my eclipse project. Please have a test. Now submitting.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

LinseyPang updated HBASE-11542:
---

Status: Patch Available  (was: Open)

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077577#comment-14077577
 ] 

LinseyPang commented on HBASE-11542:


Andrew, thanks . 

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077610#comment-14077610
 ] 

Hadoop QA commented on HBASE-11542:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12658389/hbase11542-0.99-v3.patch
  against trunk revision .
  ATTACHMENT ID: 12658389

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 21 new 
or modified tests.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
 

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s):   
at 
org.apache.hadoop.hbase.http.TestHttpServerLifecycle.testStoppedServerIsNotAlive(TestHttpServerLifecycle.java:115)

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10214//console

This message is automatically generated.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077619#comment-14077619
 ] 

LinseyPang commented on HBASE-11542:


Can give some advices for this time's failure ? thanks a lot. 

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2014-07-29 Thread Anoop Sam John (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077656#comment-14077656
 ] 

Anoop Sam John commented on HBASE-11425:


Testing with a 2 million Cells with single cell per row.
Writing all cells to a BB/DBB and trying a seek with to last kv. (To make 
compare across all cells in BB/DBB)
Seek code is like what we have in ScannerV3#blockSeek

with RK length 17 bytes (1st 13 bytes are same) Getting almost same  result.
With RK length 117 bytes (1st 113 bytes are same) the DBB based read is ~3% 
degrade.


 Cell/DBB end-to-end on the read-path
 

 Key: HBASE-11425
 URL: https://issues.apache.org/jira/browse/HBASE-11425
 Project: HBase
  Issue Type: Umbrella
  Components: regionserver, Scanners
Affects Versions: 0.99.0
Reporter: Anoop Sam John
Assignee: Anoop Sam John

 Umbrella jira to make sure we can have blocks cached in offheap backed cache. 
 In the entire read path, we can refer to this offheap buffer and avoid onheap 
 copying.
 The high level items I can identify as of now are
 1. Avoid the array() call on BB in read path.. (This is there in many 
 classes. We can handle class by class)
 2. Support Buffer based getter APIs in cell.  In read path we will create a 
 new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), 
 CPs etc.
 3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
 4. Remove all CP hooks (which are already deprecated) which deal with KVs.  
 (In read path)
 Will add subtasks under this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-4744) Remove @Ignore for testLogRollAfterSplitStart

2014-07-29 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-4744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-4744:
---

Labels: newbie  (was: )

 Remove @Ignore for testLogRollAfterSplitStart
 -

 Key: HBASE-4744
 URL: https://issues.apache.org/jira/browse/HBASE-4744
 Project: HBase
  Issue Type: Test
Affects Versions: 0.94.0
Reporter: Nicolas Spiegelberg
Priority: Critical
  Labels: newbie

 We fixed a data loss bug in HBASE-2312 by adding non-recursive creates to 
 HDFS.  Although a number of HDFS versions have this fix, the official HDFS 
 0.20.205 branch currently doesn't, so we needed to mark the test as ignored.  
 Please revisit before the RC of 0.94, which should have 0.20.205.1 or later  
 the necessary HDFS patches.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-6763) fs.default.name has been moved to fs.defaultFS we did not migrate all of the code.

2014-07-29 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1400#comment-1400
 ] 

Sean Busbey commented on HBASE-6763:


All references to fs.default.name have been removed in master. It looks like 
0.98 attempts to set both properties, but there are a few places that only set 
one or the other.

Fine to close? Or would folks like a patch against 0.98 to make our use of both 
consistent?

 fs.default.name has been moved to fs.defaultFS we did not migrate all of the 
 code.
 --

 Key: HBASE-6763
 URL: https://issues.apache.org/jira/browse/HBASE-6763
 Project: HBase
  Issue Type: Bug
  Components: master
Affects Versions: 0.95.2
Reporter: Kevin Odell
  Labels: newbie

 We are getting warning messages:
 WARN org.apache.hadoop.conf.Configuration: fs.default.name is deprecated. 
 Instead, use fs.defaultFS
 This occurs even when the core-site.xml is properly set up.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2014-07-29 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077868#comment-14077868
 ] 

Andrew Purtell commented on HBASE-11425:


This is with BB or BR? How about 1kb RKs?

 Cell/DBB end-to-end on the read-path
 

 Key: HBASE-11425
 URL: https://issues.apache.org/jira/browse/HBASE-11425
 Project: HBase
  Issue Type: Umbrella
  Components: regionserver, Scanners
Affects Versions: 0.99.0
Reporter: Anoop Sam John
Assignee: Anoop Sam John

 Umbrella jira to make sure we can have blocks cached in offheap backed cache. 
 In the entire read path, we can refer to this offheap buffer and avoid onheap 
 copying.
 The high level items I can identify as of now are
 1. Avoid the array() call on BB in read path.. (This is there in many 
 classes. We can handle class by class)
 2. Support Buffer based getter APIs in cell.  In read path we will create a 
 new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), 
 CPs etc.
 3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
 4. Remove all CP hooks (which are already deprecated) which deal with KVs.  
 (In read path)
 Will add subtasks under this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2014-07-29 Thread Anoop Sam John (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077898#comment-14077898
 ] 

Anoop Sam John commented on HBASE-11425:


BB only.  And not the actual read perf number. Just the seek part and so reads 
from BB vs DBB
bq.How about 1kb RKs?
Will test more cases.

 Cell/DBB end-to-end on the read-path
 

 Key: HBASE-11425
 URL: https://issues.apache.org/jira/browse/HBASE-11425
 Project: HBase
  Issue Type: Umbrella
  Components: regionserver, Scanners
Affects Versions: 0.99.0
Reporter: Anoop Sam John
Assignee: Anoop Sam John

 Umbrella jira to make sure we can have blocks cached in offheap backed cache. 
 In the entire read path, we can refer to this offheap buffer and avoid onheap 
 copying.
 The high level items I can identify as of now are
 1. Avoid the array() call on BB in read path.. (This is there in many 
 classes. We can handle class by class)
 2. Support Buffer based getter APIs in cell.  In read path we will create a 
 new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), 
 CPs etc.
 3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
 4. Remove all CP hooks (which are already deprecated) which deal with KVs.  
 (In read path)
 Will add subtasks under this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11540) Document HBASE-11474

2014-07-29 Thread Jimmy Xiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jimmy Xiang updated HBASE-11540:


   Resolution: Fixed
Fix Version/s: 2.0.0
   1.0.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

Thanks Misty a lot for the patch. Integrated into branch 1 and master.

 Document HBASE-11474
 

 Key: HBASE-11540
 URL: https://issues.apache.org/jira/browse/HBASE-11540
 Project: HBase
  Issue Type: Bug
  Components: documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
Priority: Critical
 Fix For: 1.0.0, 2.0.0

 Attachments: HBASE-11540-1.patch, HBASE-11540.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2014-07-29 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077940#comment-14077940
 ] 

Andrew Purtell commented on HBASE-11425:


Does it make a difference if using the BR API instead?

 Cell/DBB end-to-end on the read-path
 

 Key: HBASE-11425
 URL: https://issues.apache.org/jira/browse/HBASE-11425
 Project: HBase
  Issue Type: Umbrella
  Components: regionserver, Scanners
Affects Versions: 0.99.0
Reporter: Anoop Sam John
Assignee: Anoop Sam John

 Umbrella jira to make sure we can have blocks cached in offheap backed cache. 
 In the entire read path, we can refer to this offheap buffer and avoid onheap 
 copying.
 The high level items I can identify as of now are
 1. Avoid the array() call on BB in read path.. (This is there in many 
 classes. We can handle class by class)
 2. Support Buffer based getter APIs in cell.  In read path we will create a 
 new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), 
 CPs etc.
 3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
 4. Remove all CP hooks (which are already deprecated) which deal with KVs.  
 (In read path)
 Will add subtasks under this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077957#comment-14077957
 ] 

Ted Yu commented on HBASE-11542:


I searched in console log of the QA run for TestHttpServerLifecycle - this test 
did seem to hang.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077991#comment-14077991
 ] 

stack commented on HBASE-11425:
---

Nice [~anoop.hbase] Mind posting your little test tool so can run local?

 Cell/DBB end-to-end on the read-path
 

 Key: HBASE-11425
 URL: https://issues.apache.org/jira/browse/HBASE-11425
 Project: HBase
  Issue Type: Umbrella
  Components: regionserver, Scanners
Affects Versions: 0.99.0
Reporter: Anoop Sam John
Assignee: Anoop Sam John

 Umbrella jira to make sure we can have blocks cached in offheap backed cache. 
 In the entire read path, we can refer to this offheap buffer and avoid onheap 
 copying.
 The high level items I can identify as of now are
 1. Avoid the array() call on BB in read path.. (This is there in many 
 classes. We can handle class by class)
 2. Support Buffer based getter APIs in cell.  In read path we will create a 
 new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), 
 CPs etc.
 3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
 4. Remove all CP hooks (which are already deprecated) which deal with KVs.  
 (In read path)
 Will add subtasks under this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11474) [Thrift2] support authentication/impersonation

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078003#comment-14078003
 ] 

Hudson commented on HBASE-11474:


FAILURE: Integrated in HBase-TRUNK #5351 (See 
[https://builds.apache.org/job/HBase-TRUNK/5351/])
HBASE-11540 Document HBASE-11474 (Misty Stanley-Jones) (jxiang: rev 
9cc2b0ae9d8f08e01cc703447994368596e9874a)
* src/main/docbkx/thrift_filter_language.xml
* src/main/docbkx/security.xml


 [Thrift2] support authentication/impersonation
 --

 Key: HBASE-11474
 URL: https://issues.apache.org/jira/browse/HBASE-11474
 Project: HBase
  Issue Type: Improvement
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
 Fix For: 0.99.0, 0.98.4, 2.0.0

 Attachments: hbase-11474.patch, hbase-11474_1.patch


 This is to do the same as HBASE-11349 for Thrift2.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11540) Document HBASE-11474

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078004#comment-14078004
 ] 

Hudson commented on HBASE-11540:


FAILURE: Integrated in HBase-TRUNK #5351 (See 
[https://builds.apache.org/job/HBase-TRUNK/5351/])
HBASE-11540 Document HBASE-11474 (Misty Stanley-Jones) (jxiang: rev 
9cc2b0ae9d8f08e01cc703447994368596e9874a)
* src/main/docbkx/thrift_filter_language.xml
* src/main/docbkx/security.xml


 Document HBASE-11474
 

 Key: HBASE-11540
 URL: https://issues.apache.org/jira/browse/HBASE-11540
 Project: HBase
  Issue Type: Bug
  Components: documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
Priority: Critical
 Fix For: 1.0.0, 2.0.0

 Attachments: HBASE-11540-1.patch, HBASE-11540.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11316) Expand info about compactions beyond HBASE-11120

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078013#comment-14078013
 ] 

stack commented on HBASE-11316:
---

Interesting.  The test failures are legit:

org.apache.hadoop.hbase.regionserver.compactions.TestStripeCompactionPolicy
org.apache.hadoop.hbase.regionserver.TestDefaultCompactSelection

The hbase-default additions seem to break above tests.  Let me isolate which 
changes are responsible for the break.

 Expand info about compactions beyond HBASE-11120
 

 Key: HBASE-11316
 URL: https://issues.apache.org/jira/browse/HBASE-11316
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 2.0.0

 Attachments: HBASE-11316-1.patch, HBASE-11316-2.patch, 
 HBASE-11316-3.patch, HBASE-11316-4.patch, HBASE-11316-5.patch, 
 HBASE-11316-6-rebased-v2.patch, HBASE-11316-6-rebased.patch, 
 HBASE-11316-6.patch, HBASE-11316-7.patch, HBASE-11316-8.patch, 
 HBASE-11316-9.patch, HBASE-11316.patch, ch9_compactions.pdf


 Round 2 - expand info about the algorithms, talk about stripe compaction, and 
 talk more about configuration. Hopefully find some rules of thumb.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-6763) fs.default.name has been moved to fs.defaultFS we did not migrate all of the code.

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078019#comment-14078019
 ] 

stack commented on HBASE-6763:
--

Getting rid of WARNs would be a nice-to-have but if you want to work on 
something more pressing, that'd be cool too Mr. [~busbey]

 fs.default.name has been moved to fs.defaultFS we did not migrate all of the 
 code.
 --

 Key: HBASE-6763
 URL: https://issues.apache.org/jira/browse/HBASE-6763
 Project: HBase
  Issue Type: Bug
  Components: master
Affects Versions: 0.95.2
Reporter: Kevin Odell
  Labels: newbie

 We are getting warning messages:
 WARN org.apache.hadoop.conf.Configuration: fs.default.name is deprecated. 
 Instead, use fs.defaultFS
 This occurs even when the core-site.xml is properly set up.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-9741) Remove hbase.regions.slop from hbase-default.xml

2014-07-29 Thread Esteban Gutierrez (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078049#comment-14078049
 ] 

Esteban Gutierrez commented on HBASE-9741:
--

Why not rename the {{hbase.regions.slop}} initially to 
{{hbase.regions.balancer.base.slop}} and add a new property for the 
StochasticLoadBalancer {{hbase.regions.balancer.stochastic.slop}}. Then we can 
deprecate gracefully {{hbase.regions.slop}} with a warning and still support 
the property for a while.

 Remove hbase.regions.slop from hbase-default.xml
 

 Key: HBASE-9741
 URL: https://issues.apache.org/jira/browse/HBASE-9741
 Project: HBase
  Issue Type: Bug
Reporter: Elliott Clark
  Labels: noob
 Attachments: HBASE-9741-v0.patch, HBASE-9741-v1.patch


 Different balancers have different slop default values.  We should remove 
 hbase.regions.slop from hbase-default.xml



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11558:
---

Status: Open  (was: Patch Available)

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11558:
---

Attachment: HBASE_11558_v2.patch

Attach trunk patch again to be most current

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11558:
---

Status: Patch Available  (was: Open)

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11316) Expand info about compactions beyond HBASE-11120

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11316:
--

Attachment: addendum.txt

Addendum. The two failing tests don't like the setting of explicit new default 
in hbase-default.xml of hbase.hstore.compaction.min.size so just unset this 
value so these tests pass again.

 Expand info about compactions beyond HBASE-11120
 

 Key: HBASE-11316
 URL: https://issues.apache.org/jira/browse/HBASE-11316
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 2.0.0

 Attachments: HBASE-11316-1.patch, HBASE-11316-2.patch, 
 HBASE-11316-3.patch, HBASE-11316-4.patch, HBASE-11316-5.patch, 
 HBASE-11316-6-rebased-v2.patch, HBASE-11316-6-rebased.patch, 
 HBASE-11316-6.patch, HBASE-11316-7.patch, HBASE-11316-8.patch, 
 HBASE-11316-9.patch, HBASE-11316.patch, addendum.txt, ch9_compactions.pdf


 Round 2 - expand info about the algorithms, talk about stripe compaction, and 
 talk more about configuration. Hopefully find some rules of thumb.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11316) Expand info about compactions beyond HBASE-11120

2014-07-29 Thread Jean-Daniel Cryans (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078104#comment-14078104
 ] 

Jean-Daniel Cryans commented on HBASE-11316:


+1, thanks for looking at this Stack and sorry I overlooked those failing tests.

 Expand info about compactions beyond HBASE-11120
 

 Key: HBASE-11316
 URL: https://issues.apache.org/jira/browse/HBASE-11316
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 2.0.0

 Attachments: HBASE-11316-1.patch, HBASE-11316-2.patch, 
 HBASE-11316-3.patch, HBASE-11316-4.patch, HBASE-11316-5.patch, 
 HBASE-11316-6-rebased-v2.patch, HBASE-11316-6-rebased.patch, 
 HBASE-11316-6.patch, HBASE-11316-7.patch, HBASE-11316-8.patch, 
 HBASE-11316-9.patch, HBASE-11316.patch, addendum.txt, ch9_compactions.pdf


 Round 2 - expand info about the algorithms, talk about stripe compaction, and 
 talk more about configuration. Hopefully find some rules of thumb.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078141#comment-14078141
 ] 

Hadoop QA commented on HBASE-11558:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658453/HBASE_11558_v2.patch
  against trunk revision .
  ATTACHMENT ID: 12658453

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 3 new 
or modified tests.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 lineLengths{color}.  The patch introduces the following lines 
longer than 100:
+  \022\024\n\014more_results\030\003 
\001(\010\022\013\n\003ttl\030\004 \001(\r\022\030\n\007r +
+  new java.lang.String[] { Column, Attribute, StartRow, 
StopRow, Filter, TimeRange, MaxVersions, CacheBlocks, BatchSize, 
MaxResultSize, StoreLimit, StoreOffset, LoadColumnFamiliesOnDemand, 
Small, Reversed, Consistency, Caching, });

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.regionserver.compactions.TestStripeCompactionPolicy
  
org.apache.hadoop.hbase.regionserver.TestDefaultCompactSelection

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10215//console

This message is automatically generated.

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying 

[jira] [Commented] (HBASE-9741) Remove hbase.regions.slop from hbase-default.xml

2014-07-29 Thread Elliott Clark (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078153#comment-14078153
 ] 

Elliott Clark commented on HBASE-9741:
--

Because the stochastic balancer doesn't really use the slop in the same way.  
It computes costs, so slop isn't really used to determine when a balance plan 
is good.

 Remove hbase.regions.slop from hbase-default.xml
 

 Key: HBASE-9741
 URL: https://issues.apache.org/jira/browse/HBASE-9741
 Project: HBase
  Issue Type: Bug
Reporter: Elliott Clark
  Labels: noob
 Attachments: HBASE-9741-v0.patch, HBASE-9741-v1.patch


 Different balancers have different slop default values.  We should remove 
 hbase.regions.slop from hbase-default.xml



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-9741) Remove hbase.regions.slop from hbase-default.xml

2014-07-29 Thread Esteban Gutierrez (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078156#comment-14078156
 ] 

Esteban Gutierrez commented on HBASE-9741:
--

[~eclark] then it might be better to rename {{hbase.regions.slop}} the the 
StochasticLoadBalancer to {{hbase.regions.stochastic.load.balancer.cost}} and 
do not rename {{hbase.regions.slop}} does it sounds good?

 Remove hbase.regions.slop from hbase-default.xml
 

 Key: HBASE-9741
 URL: https://issues.apache.org/jira/browse/HBASE-9741
 Project: HBase
  Issue Type: Bug
Reporter: Elliott Clark
  Labels: noob
 Attachments: HBASE-9741-v0.patch, HBASE-9741-v1.patch


 Different balancers have different slop default values.  We should remove 
 hbase.regions.slop from hbase-default.xml



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HBASE-11608) Add synchronous split

2014-07-29 Thread Jerry He (JIRA)
Jerry He created HBASE-11608:


 Summary: Add synchronous split
 Key: HBASE-11608
 URL: https://issues.apache.org/jira/browse/HBASE-11608
 Project: HBase
  Issue Type: New Feature
  Components: Admin
Affects Versions: 0.99.0, 0.98.5
Reporter: Jerry He


Users have been asking for this. We have an internal requirement for this as 
well.
The goal is a provide a Admin API (and shell command) so that users can request 
to split a region or table and get the split completion result synchronously.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11608) Add synchronous split

2014-07-29 Thread Jerry He (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078179#comment-14078179
 ] 

Jerry He commented on HBASE-11608:
--

Linked to an old issue that raised this request.

 Add synchronous split
 -

 Key: HBASE-11608
 URL: https://issues.apache.org/jira/browse/HBASE-11608
 Project: HBase
  Issue Type: New Feature
  Components: Admin
Affects Versions: 0.99.0, 0.98.5
Reporter: Jerry He

 Users have been asking for this. We have an internal requirement for this as 
 well.
 The goal is a provide a Admin API (and shell command) so that users can 
 request to split a region or table and get the split completion result 
 synchronously.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11608) Add synchronous split

2014-07-29 Thread Jerry He (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078215#comment-14078215
 ] 

Jerry He commented on HBASE-11608:
--

Carry over the design comment from HBase-2949 so we will continue the 
discussion here.

+Current implementation on the client side+

In HBaseAdmin.split(), 
1. Input is a region name
1a. If a split key is given, we will send a split request to the region server 
hosting the region containing the key. Asynchronous operation.
2b. If no split key, we will send a split request to the region server hosting 
the region to split based split policy. Asynchronous operation.
2. Input is a table name
1a. If a split key is given, we will send a split request to the region server 
hosting the region containing the key. Asynchronous operation.
2b. If no split key, we will send split requests in a loop to (region, rs) pair 
for all the regions of the table to split based split policy. Asynchronous 
operation.

+Current implementation on the region server side+

HRegionServer - RSRpcServices.splitRegion() - 
compactSplitThread.requestSplit() -- CompactSplitThread.splits.execute(new 
SplitRequest())
CompactSplitThread.splits is a ThreadPoolExecutor.
SplitRequest is a Runnable that does all the slit work.

+Goal+

Backward compatible, no impact on existing system triggered split, minimum 
overall impact, more??

+Proposed change on the region server side+

Provide a synchronous
compactSplitThread.requestSplitSynchronous() -- 
CompactSplitThread.splits.submit(new SplitRequest()) and wait for 'future' 
completion.
SplitRequest currently is a Runnable. 
Possibly change it to CallableVoid so that we can propagate up any exceptions 
during split operation
as we want to get notified any errors/exceptions synchronously as well.
HRegionServer - RSRpcServices.splitRegionSynchronous() will use the new 
requestSplitSynchronous().

+On the HBaseAdmin side+

If we go synchronous in HBaseAdmin.split(), one use case scenario will become 
less efficient. i.e. the 2.b case from above:
bq. 2b. If no split key, we will send split requests in a loop to (region, rs) 
pair for all the regions of the table to split based split policy.
Because in this case, each (region, rs) pair will be requested serially and 
synchronously.
We'll provide a HBaseAdmin.splitSynchronous() and keep the current asynchronous 
HBaseAdmin.split(). 
Users are kept aware of the choices they have.
In the future HBaseAdmin.splitSynchronous() can be improved (e.g. using Global 
procedure in split regions in parallel).

This is my initial thinking. 
Your comments please, if this is doable, if there is any concern, if I miss or 
misunderstand anything. I am sure I do :-)

 Add synchronous split
 -

 Key: HBASE-11608
 URL: https://issues.apache.org/jira/browse/HBASE-11608
 Project: HBase
  Issue Type: New Feature
  Components: Admin
Affects Versions: 0.99.0, 0.98.5
Reporter: Jerry He

 Users have been asking for this. We have an internal requirement for this as 
 well.
 The goal is a provide a Admin API (and shell command) so that users can 
 request to split a region or table and get the split completion result 
 synchronously.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-11609:


Attachment: HBASE-11609-v0.patch

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The problem is related to the ':' symbol going to the file path. the simple 
 fix is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-11609:
---

 Summary: LoadIncrementalHFiles fails if the namespace is specified
 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 0.98.4, 1.0.0, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0
 Attachments: HBASE-11609-v0.patch

from Jianshi Huang on the user list
trying to bulk load a table in a namespace, like:
$ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ foo:testtb

we get an exception
{code}
2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
Unexpected execution exception during splitting
java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
java.net.URISyntaxException: Relative path in absolute URI: foo:testtb,1.bottom
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at 
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
at 
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
at 
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
{code}

The problem is related to the ':' symbol going to the file path. the simple fix 
is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-11609:


Status: Patch Available  (was: Open)

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 0.98.4, 1.0.0, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The problem is related to the ':' symbol going to the file path. the simple 
 fix is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078273#comment-14078273
 ] 

Hadoop QA commented on HBASE-11609:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658468/HBASE-11609-v0.patch
  against trunk revision .
  ATTACHMENT ID: 12658468

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.regionserver.compactions.TestStripeCompactionPolicy
  
org.apache.hadoop.hbase.regionserver.TestDefaultCompactSelection

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10216//console

This message is automatically generated.

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The 

[jira] [Commented] (HBASE-11608) Add synchronous split

2014-07-29 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078343#comment-14078343
 ] 

Nick Dimiduk commented on HBASE-11608:
--

Nice feature [~jinghe].

How will your future approach handle intermittent connectivity issues between 
client and RS? Have you looked at HBASE-5487 ?

 Add synchronous split
 -

 Key: HBASE-11608
 URL: https://issues.apache.org/jira/browse/HBASE-11608
 Project: HBase
  Issue Type: New Feature
  Components: Admin
Affects Versions: 0.99.0, 0.98.5
Reporter: Jerry He

 Users have been asking for this. We have an internal requirement for this as 
 well.
 The goal is a provide a Admin API (and shell command) so that users can 
 request to split a region or table and get the split completion result 
 synchronously.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-2949) Add synchronous compact/split/flush or add a callback that gets pulled when compact/split/flush completes (and a progressable on how much is done)

2014-07-29 Thread Jerry He (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078340#comment-14078340
 ] 

Jerry He commented on HBASE-2949:
-

Opened HBASE-11608

 Add synchronous compact/split/flush or add a callback that gets pulled when 
 compact/split/flush completes (and a progressable on how much is done)
 --

 Key: HBASE-2949
 URL: https://issues.apache.org/jira/browse/HBASE-2949
 Project: HBase
  Issue Type: New Feature
Reporter: stack

 Users have asked for this w/ a while.  They start a major compaction and are 
 a little baffled when the shell returns immediately.  We need to make the 
 call synchronous or add a callback or provide a progressable so user can see 
 how complete the task is.  Should we include a cancel task?  Hey! Why did 
 everything go slow of a sudden?  5 minutes later A major compaction 
 started on hbase... how do we turn it off?
 The need for this feature was also mentioned in HBASE-2701



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11474) [Thrift2] support authentication/impersonation

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078355#comment-14078355
 ] 

Hudson commented on HBASE-11474:


FAILURE: Integrated in HBase-1.0 #74 (See 
[https://builds.apache.org/job/HBase-1.0/74/])
HBASE-11540 Document HBASE-11474 (Misty Stanley-Jones) (jxiang: rev 
90eb08eda58f5d921f4c311cfd50ae55dbb1b7d6)
* src/main/docbkx/security.xml
* src/main/docbkx/thrift_filter_language.xml


 [Thrift2] support authentication/impersonation
 --

 Key: HBASE-11474
 URL: https://issues.apache.org/jira/browse/HBASE-11474
 Project: HBase
  Issue Type: Improvement
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
 Fix For: 0.99.0, 0.98.4, 2.0.0

 Attachments: hbase-11474.patch, hbase-11474_1.patch


 This is to do the same as HBASE-11349 for Thrift2.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11540) Document HBASE-11474

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078356#comment-14078356
 ] 

Hudson commented on HBASE-11540:


FAILURE: Integrated in HBase-1.0 #74 (See 
[https://builds.apache.org/job/HBase-1.0/74/])
HBASE-11540 Document HBASE-11474 (Misty Stanley-Jones) (jxiang: rev 
90eb08eda58f5d921f4c311cfd50ae55dbb1b7d6)
* src/main/docbkx/security.xml
* src/main/docbkx/thrift_filter_language.xml


 Document HBASE-11474
 

 Key: HBASE-11540
 URL: https://issues.apache.org/jira/browse/HBASE-11540
 Project: HBase
  Issue Type: Bug
  Components: documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
Priority: Critical
 Fix For: 1.0.0, 2.0.0

 Attachments: HBASE-11540-1.patch, HBASE-11540.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Jimmy Xiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jimmy Xiang updated HBASE-11606:


Attachment: hbase-11606.patch

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Jimmy Xiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jimmy Xiang updated HBASE-11606:


Status: Patch Available  (was: Open)

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Mikhail Antonov (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078372#comment-14078372
 ] 

Mikhail Antonov commented on HBASE-11606:
-

Looks good to me. No changes in tests are needed, when this value is used? Like 
TestMasterFailover?

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Ishan Chhabra (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078381#comment-14078381
 ] 

Ishan Chhabra commented on HBASE-11558:
---

Test failures are due to HBASE-11316

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Ishan Chhabra (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078385#comment-14078385
 ] 

Ishan Chhabra commented on HBASE-11558:
---

[~apurtell], how can I trigger the build for 0.96 and 0.98 patches? 

 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11558) Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+

2014-07-29 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078391#comment-14078391
 ] 

Andrew Purtell commented on HBASE-11558:


You cannot. Precommit builds always check out trunk. The test failures reported 
in the last precommit build do not look related. 

+1 for commit


 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+
 ---

 Key: HBASE-11558
 URL: https://issues.apache.org/jira/browse/HBASE-11558
 Project: HBase
  Issue Type: Bug
  Components: mapreduce, Scanners
Reporter: Ishan Chhabra
Assignee: Ishan Chhabra
 Fix For: 0.99.0, 0.96.3, 0.98.5, 2.0.0

 Attachments: HBASE_11558-0.96.patch, HBASE_11558-0.96_v2.patch, 
 HBASE_11558-0.98.patch, HBASE_11558-0.98_v2.patch, HBASE_11558.patch, 
 HBASE_11558_v2.patch, HBASE_11558_v2.patch


 0.94 and before, if one sets caching on the Scan object in the Job by calling 
 scan.setCaching(int) and passes it to TableMapReduceUtil, it is correctly 
 read and used by the mappers during a mapreduce job. This is because 
 Scan.write respects and serializes caching, which is used internally by 
 TableMapReduceUtil to serialize and transfer the scan object to the mappers.
 0.95+, after the move to protobuf, ProtobufUtil.toScan does not respect 
 caching anymore as ClientProtos.Scan does not have the field caching. Caching 
 is passed via the ScanRequest object to the server and so is not needed in 
 the Scan object. However, this breaks application code that relies on the 
 earlier behavior. This will lead to sudden degradation in Scan performance 
 0.96+ for users relying on the old behavior.
 There are 2 options here:
 1. Add caching to Scan object, adding an extra int to the payload for the 
 Scan object which is really not needed in the general case.
 2. Document and preach that TableMapReduceUtil.setScannerCaching must be 
 called by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078419#comment-14078419
 ] 

Ted Yu commented on HBASE-11609:


{code}
+  private String getUniqueName(TableName tableName) {
{code}
unique name is not related to table name any more. tableName parameter can be 
omitted, right ?

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The problem is related to the ':' symbol going to the file path. the simple 
 fix is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078428#comment-14078428
 ] 

Hadoop QA commented on HBASE-11606:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658486/hbase-11606.patch
  against trunk revision .
  ATTACHMENT ID: 12658486

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.regionserver.compactions.TestStripeCompactionPolicy
  
org.apache.hadoop.hbase.regionserver.TestDefaultCompactSelection

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10217//console

This message is automatically generated.

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-11609:


Attachment: HBASE-11609-v1.patch

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch, HBASE-11609-v1.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The problem is related to the ':' symbol going to the file path. the simple 
 fix is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078505#comment-14078505
 ] 

stack commented on HBASE-11606:
---

+1

Failures are not yours.

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078506#comment-14078506
 ] 

stack commented on HBASE-11606:
---

Needs a release note.

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HBASE-11610) Enhance remote meta updates

2014-07-29 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-11610:
---

 Summary: Enhance remote meta updates
 Key: HBASE-11610
 URL: https://issues.apache.org/jira/browse/HBASE-11610
 Project: HBase
  Issue Type: Improvement
Reporter: Jimmy Xiang


Currently, if the meta region is on a regionserver instead of the master, meta 
update is synchronized on one HTable instance. We should be able to do better.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078522#comment-14078522
 ] 

Hadoop QA commented on HBASE-11609:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658498/HBASE-11609-v1.patch
  against trunk revision .
  ATTACHMENT ID: 12658498

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.regionserver.compactions.TestStripeCompactionPolicy
  
org.apache.hadoop.hbase.regionserver.TestDefaultCompactSelection

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10218//console

This message is automatically generated.

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch, HBASE-11609-v1.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at 

[jira] [Created] (HBASE-11611) Clean up ZK-based region assignment

2014-07-29 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-11611:
---

 Summary: Clean up ZK-based region assignment
 Key: HBASE-11611
 URL: https://issues.apache.org/jira/browse/HBASE-11611
 Project: HBase
  Issue Type: Improvement
  Components: Region Assignment
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
 Fix For: 2.0.0


We can clean up the ZK-based region assignment code and use the ZK-less one in 
the master branch, to make the code easier to understand and maintain.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Jimmy Xiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jimmy Xiang updated HBASE-11606:


  Resolution: Fixed
Release Note: By default, we don't use ZK for region assignment now. To 
fall back to the old way, you can set hbase.assignment.usezk to true.
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Integrated into master. Thanks. 

 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11606) Enable ZK-less region assignment by default

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078578#comment-14078578
 ] 

Hudson commented on HBASE-11606:


FAILURE: Integrated in HBase-TRUNK #5352 (See 
[https://builds.apache.org/job/HBase-TRUNK/5352/])
HBASE-11606 Enable ZK-less region assignment by default (jxiang: rev 
7f9ec95831d2a5f8a17b45f3bf91d7bd441153a1)
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperWatcher.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/ConfigUtil.java


 Enable ZK-less region assignment by default
 ---

 Key: HBASE-11606
 URL: https://issues.apache.org/jira/browse/HBASE-11606
 Project: HBase
  Issue Type: Task
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
Priority: Minor
 Fix For: 2.0.0

 Attachments: hbase-11606.patch


 Let's enable ZK-less region assignment by default in the master branch.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078598#comment-14078598
 ] 

Nick Dimiduk commented on HBASE-11607:
--

Would it be possible to create a flat table of metric name = description that 
can be generated and published in the book? I think having an offline reference 
is quite helpful for folks who don't have a running hbase and who have no 
experience with (or inkling of) JMX.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 0.94.1, 0.95.0






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11608) Add synchronous split

2014-07-29 Thread Jerry He (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078597#comment-14078597
 ] 

Jerry He commented on HBASE-11608:
--

Hi, [~ndimiduk]

I was aware of the grand plan in  HBASE-5487, and just went though it again :-)

bq. How will your future approach handle intermittent connectivity issues 
between client and RS?
If client issues synchronous split request, the client RPC connection will hold 
for longer period of time.

Or do you mean in the future if we want to use Master-coordinated tasks to splt 
the table synchronously, how do we deal with master and/or RS failures?


 Add synchronous split
 -

 Key: HBASE-11608
 URL: https://issues.apache.org/jira/browse/HBASE-11608
 Project: HBase
  Issue Type: New Feature
  Components: Admin
Affects Versions: 0.99.0, 0.98.5
Reporter: Jerry He

 Users have been asking for this. We have an internal requirement for this as 
 well.
 The goal is a provide a Admin API (and shell command) so that users can 
 request to split a region or table and get the split completion result 
 synchronously.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078602#comment-14078602
 ] 

Misty Stanley-Jones commented on HBASE-11607:
-

Thanks [~stack] that is perfect info. Good idea, [~ndimiduk] and I will 
experiment with doing that the same way we do for the hbase-default.xml and 
putting it into an appendix.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 0.94.1, 0.95.0






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11610) Enhance remote meta updates

2014-07-29 Thread Virag Kothari (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078663#comment-14078663
 ] 

Virag Kothari commented on HBASE-11610:
---

I was working on this and saw quite a bit of improvement when I used 
connection.getHTable() (uses a pool internally) to get a meta table instance. 
Will provide an update soon.

 Enhance remote meta updates
 ---

 Key: HBASE-11610
 URL: https://issues.apache.org/jira/browse/HBASE-11610
 Project: HBase
  Issue Type: Improvement
Reporter: Jimmy Xiang

 Currently, if the meta region is on a regionserver instead of the master, 
 meta update is synchronized on one HTable instance. We should be able to do 
 better.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Assigned] (HBASE-11610) Enhance remote meta updates

2014-07-29 Thread Virag Kothari (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Virag Kothari reassigned HBASE-11610:
-

Assignee: Virag Kothari

 Enhance remote meta updates
 ---

 Key: HBASE-11610
 URL: https://issues.apache.org/jira/browse/HBASE-11610
 Project: HBase
  Issue Type: Improvement
Reporter: Jimmy Xiang
Assignee: Virag Kothari

 Currently, if the meta region is on a regionserver instead of the master, 
 meta update is synchronized on one HTable instance. We should be able to do 
 better.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HBASE-11612) Remove MetaMigrationConvertingToPB

2014-07-29 Thread Virag Kothari (JIRA)
Virag Kothari created HBASE-11612:
-

 Summary: Remove MetaMigrationConvertingToPB 
 Key: HBASE-11612
 URL: https://issues.apache.org/jira/browse/HBASE-11612
 Project: HBase
  Issue Type: Bug
Affects Versions: 0.98.4
Reporter: Virag Kothari
Priority: Minor


Can MetaMigrationConvertingToPB be removed now from 0.98 onwards? The javadoc 
says it should be removed on a major release after 0.96. It does a full Meta 
scan which takes quite some time especially if there are around 1M regions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11612) Remove MetaMigrationConvertingToPB

2014-07-29 Thread Mikhail Antonov (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078681#comment-14078681
 ] 

Mikhail Antonov commented on HBASE-11612:
-

That was already raised before and there's some discussion in other jira. 
Suggesting to close this one as a dup.

 Remove MetaMigrationConvertingToPB 
 ---

 Key: HBASE-11612
 URL: https://issues.apache.org/jira/browse/HBASE-11612
 Project: HBase
  Issue Type: Bug
Affects Versions: 0.98.4
Reporter: Virag Kothari
Priority: Minor

 Can MetaMigrationConvertingToPB be removed now from 0.98 onwards? The javadoc 
 says it should be removed on a major release after 0.96. It does a full Meta 
 scan which takes quite some time especially if there are around 1M regions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (HBASE-11612) Remove MetaMigrationConvertingToPB

2014-07-29 Thread Virag Kothari (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Virag Kothari resolved HBASE-11612.
---

Resolution: Duplicate

 Remove MetaMigrationConvertingToPB 
 ---

 Key: HBASE-11612
 URL: https://issues.apache.org/jira/browse/HBASE-11612
 Project: HBase
  Issue Type: Bug
Affects Versions: 0.98.4
Reporter: Virag Kothari
Priority: Minor

 Can MetaMigrationConvertingToPB be removed now from 0.98 onwards? The javadoc 
 says it should be removed on a major release after 0.96. It does a full Meta 
 scan which takes quite some time especially if there are around 1M regions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread LinseyPang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078762#comment-14078762
 ] 

LinseyPang commented on HBASE-11542:


Hi,Ted,

1. I created a local branch from origin/master and loaded into eclipse. On this 
local branch, I added several classes under package 
oforg.apache.hadoop.hbase.http.ssl for solving jdk incompatible issue and one 
test class named as TestX509Factory.java under package 
org.apache.hadoop.hbase.http. The unit test TestX509Factory.java succeeded on 
my local machine. 2. To test whether the failure is because of the new classed 
I created, I created a new local branch from origin/master without adding any 
new code. The org.apache.hadoop.hbase.http.TestHttpServerLifecycle is also 
failed.  Error is : java.io.IOException: Could not locate executable 
null\bin\winutils.exe in the Hadoop binaries. It seems the failure is because I 
am using windows os, need to re-compile hadoop binary. 3. So I don't think the 
failure is from the new added classes from my side. Am I correct ? Please give 
advice. Thanks a lot.  

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078768#comment-14078768
 ] 

Ted Yu commented on HBASE-11542:


bq. the failure is because I am using windows os

Hadoop QA only tests on Linux - for hbase that is, I don't know about other 
projects.
Please find proper environment and do the above verification.

Thanks

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11316) Expand info about compactions beyond HBASE-11120

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078779#comment-14078779
 ] 

stack commented on HBASE-11316:
---

Pushed addendum.  [~jdcryans] now I only owe you $2.1455M dollars.

 Expand info about compactions beyond HBASE-11120
 

 Key: HBASE-11316
 URL: https://issues.apache.org/jira/browse/HBASE-11316
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 2.0.0

 Attachments: HBASE-11316-1.patch, HBASE-11316-2.patch, 
 HBASE-11316-3.patch, HBASE-11316-4.patch, HBASE-11316-5.patch, 
 HBASE-11316-6-rebased-v2.patch, HBASE-11316-6-rebased.patch, 
 HBASE-11316-6.patch, HBASE-11316-7.patch, HBASE-11316-8.patch, 
 HBASE-11316-9.patch, HBASE-11316.patch, addendum.txt, ch9_compactions.pdf


 Round 2 - expand info about the algorithms, talk about stripe compaction, and 
 talk more about configuration. Hopefully find some rules of thumb.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11542:
--

Attachment: hbase11542-0.99-v3.patch

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase11542-0.99-v3.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078800#comment-14078800
 ] 

stack commented on HBASE-11542:
---

[~Linsey] I see that test failing elsewhere so likely not related to your 
patch.  It passes for me locally.  Let me reupload it and see what happens the 
second time HadoopQA runs it.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase11542-0.99-v3.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078802#comment-14078802
 ] 

stack commented on HBASE-11542:
---

[~Linsey] Factory seems fine.  You looked at the JVM class and it too hard to 
coral JVM vendor stuff inside there? What did you think of the 
[~andrew.purt...@gmail.com] notion above of Instead of programmatically 
creating a keystore containing a self-signed certificate and keypair, perhaps 
we can generate one once by hand, stringify it, and just use that? Thanks.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase11542-0.99-v3.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11333) Remove deprecated class MetaMigrationConvertingToPB

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078806#comment-14078806
 ] 

stack commented on HBASE-11333:
---

[~virag] Want to add a configuration so the scan is skipped in 0.98?

 Remove deprecated class MetaMigrationConvertingToPB
 ---

 Key: HBASE-11333
 URL: https://issues.apache.org/jira/browse/HBASE-11333
 Project: HBase
  Issue Type: Bug
  Components: master
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
Priority: Trivial
 Fix For: 0.99.0

 Attachments: HBASE-11333.patch


 MetaMigrationConvertingToPB is marked deprecated and to be deleted next major 
 release after 0.96. Is that the time?



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078815#comment-14078815
 ] 

stack commented on HBASE-11607:
---

bq. ...and I will experiment with doing that the same way we do for the 
hbase-default.xml and putting it into an appendix.

A program to spin up a regionserver and scrape the RS /metrics (only with 
description added) that is run as part of the docs build IF we do not have a 
cached version?  Shouldn't be too bad.  Would be good to have the UI show the 
metric attribute name and description in a /full-jmx servlet (or 
/jmxformat=full)  Seems like we'd have to do a littlle fancy dancing to get 
the description but just foot work.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Fix For: 0.94.1, 0.95.0






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11607) Document HBase metrics

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11607:
--

Labels: noob  (was: )

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Fix For: 0.94.1, 0.95.0






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11609) LoadIncrementalHFiles fails if the namespace is specified

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078823#comment-14078823
 ] 

stack commented on HBASE-11609:
---

+1 [~mbertozzi] The failures are not yours (should be fixed now anyways)

 LoadIncrementalHFiles fails if the namespace is specified
 -

 Key: HBASE-11609
 URL: https://issues.apache.org/jira/browse/HBASE-11609
 Project: HBase
  Issue Type: Bug
  Components: Client
Affects Versions: 1.0.0, 0.98.4, 2.0.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
 Fix For: 1.0.0, 0.98.5, 2.0.0

 Attachments: HBASE-11609-v0.patch, HBASE-11609-v1.patch


 from Jianshi Huang on the user list
 trying to bulk load a table in a namespace, like:
 $ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles test/ 
 foo:testtb
 we get an exception
 {code}
 2014-07-29 19:59:53,373 ERROR [main] mapreduce.LoadIncrementalHFiles: 
 Unexpected execution exception during splitting
 java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
 java.net.URISyntaxException: Relative path in absolute URI: 
 foo:testtb,1.bottom
 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
 at java.util.concurrent.FutureTask.get(FutureTask.java:188)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:449)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:304)
 at 
 org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:899)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 {code}
 The problem is related to the ':' symbol going to the file path. the simple 
 fix is to replace the current LoadIncrementalHFiles.getUniqueName()



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11527) Cluster free memory limit check should consider L2 block cache size also when L2 cache is onheap.

2014-07-29 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078825#comment-14078825
 ] 

stack commented on HBASE-11527:
---

Very nice. Only nit is your moving of CacheConfig Constants up to HConstant.  
Do you have to?  Rerun through hadoopqa again too boss to be sure.

 Cluster free memory limit check should consider L2 block cache size also when 
 L2 cache is onheap.
 -

 Key: HBASE-11527
 URL: https://issues.apache.org/jira/browse/HBASE-11527
 Project: HBase
  Issue Type: Bug
Reporter: Anoop Sam John
Assignee: Anoop Sam John
 Fix For: 2.0.0

 Attachments: HBASE-11527.patch, HBASE-11527.patch, HBASE-11527.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078863#comment-14078863
 ] 

Hadoop QA commented on HBASE-11542:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12658573/hbase11542-0.99-v3.patch
  against trunk revision .
  ATTACHMENT ID: 12658573

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 21 new 
or modified tests.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   org.apache.hadoop.hbase.TestIOFencing
  org.apache.hadoop.hbase.master.TestRestartCluster
  
org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction
  org.apache.hadoop.hbase.regionserver.TestRegionReplicas
  org.apache.hadoop.hbase.client.TestReplicasClient
  org.apache.hadoop.hbase.migration.TestNamespaceUpgrade

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s): 

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10219//console

This message is automatically generated.

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase11542-0.99-v3.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078871#comment-14078871
 ] 

Misty Stanley-Jones commented on HBASE-11607:
-

It would also be interesting to mark the metrics with stability markers or 
something in the way we do with public APIs. They sure seem to change a lot, 
and I imagine folks would like to be able to rely on them.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Fix For: 0.94.1, 0.95.0

 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones updated HBASE-11607:


Attachment: HBASE-11607.patch

Documented how to find the metrics. I tried to sync the existing list of 
metrics with reality but there were too many that had been renamed multiple 
times, lots had disappeared, etc, so I yanked those lists completely. It sounds 
like getting the nicely-formatted list like we do for hbase-default.xml will be 
more involved so I will wait for some help on that.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Fix For: 0.94.1, 0.95.0

 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones updated HBASE-11607:


Fix Version/s: (was: 0.95.0)
   (was: 0.94.1)
   Status: Patch Available  (was: Open)

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones updated HBASE-11607:


Attachment: HBASE-11607.patch

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Misty Stanley-Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones updated HBASE-11607:


Attachment: (was: HBASE-11607.patch)

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078873#comment-14078873
 ] 

Hadoop QA commented on HBASE-11607:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org
  against trunk revision .
  ATTACHMENT ID: http:

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+0 tests included{color}.  The patch appears to be a 
documentation patch that doesn't require tests.

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10220//console

This message is automatically generated.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11542) Unit Test KeyStoreTestUtil.java compilation failure in IBM JDK

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11542:
--

Attachment: hbase11542-0.99-v3.patch

Retry.

Do the failed tests fail locally for you [~Linsey] ?

 Unit Test  KeyStoreTestUtil.java compilation failure in IBM JDK 
 

 Key: HBASE-11542
 URL: https://issues.apache.org/jira/browse/HBASE-11542
 Project: HBase
  Issue Type: Improvement
  Components: build, test
Affects Versions: 0.99.0
 Environment: RHEL 6.3 ,IBM JDK 6
Reporter: LinseyPang
Priority: Minor
 Fix For: 2.0.0

 Attachments: HBASE_11542-1.patch, hbase11542-0.99-v3.patch, 
 hbase11542-0.99-v3.patch, hbase11542-0.99-v3.patch, hbase_11542-v2.patch


 In trunk,  jira HBase-10336 added a utility test KeyStoreTestUtil.java, which 
 leverages the following sun classes:
    import sun.security.x509.AlgorithmId;
    import sun.security.x509.CertificateAlgorithmId;
   
 this cause hbase compiler failure if using IBM JDK,  
 There are similar classes like below in IBM jdk: 
 import com.ibm.security.x509.AlgorithmId;
 import com.ibm.security.x509.CertificateAlgorithmId; 
 This jira is to add handling of the x509 references. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11527) Cluster free memory limit check should consider L2 block cache size also when L2 cache is onheap.

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11527:
--

Attachment: HBASE-11527.patch

Retry

 Cluster free memory limit check should consider L2 block cache size also when 
 L2 cache is onheap.
 -

 Key: HBASE-11527
 URL: https://issues.apache.org/jira/browse/HBASE-11527
 Project: HBase
  Issue Type: Bug
Reporter: Anoop Sam John
Assignee: Anoop Sam John
 Fix For: 2.0.0

 Attachments: HBASE-11527.patch, HBASE-11527.patch, HBASE-11527.patch, 
 HBASE-11527.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11527) Cluster free memory limit check should consider L2 block cache size also when L2 cache is onheap.

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078880#comment-14078880
 ] 

Hadoop QA commented on HBASE-11527:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658589/HBASE-11527.patch
  against trunk revision .
  ATTACHMENT ID: 12658589

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 6 new 
or modified tests.

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10221//console

This message is automatically generated.

 Cluster free memory limit check should consider L2 block cache size also when 
 L2 cache is onheap.
 -

 Key: HBASE-11527
 URL: https://issues.apache.org/jira/browse/HBASE-11527
 Project: HBase
  Issue Type: Bug
Reporter: Anoop Sam John
Assignee: Anoop Sam John
 Fix For: 2.0.0

 Attachments: HBASE-11527.patch, HBASE-11527.patch, HBASE-11527.patch, 
 HBASE-11527.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11120) Update documentation about major compaction algorithm

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078882#comment-14078882
 ] 

Hudson commented on HBASE-11120:


FAILURE: Integrated in HBase-TRUNK #5353 (See 
[https://builds.apache.org/job/HBase-TRUNK/5353/])
HBASE-11316 Expand info about compactions beyond HBASE-11120 ADDENDUM TO FIX 
BROKE TESTS (stack: rev 85853f69c88c08db61af7fb6ef3b5432f926e531)
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultCompactSelection.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestStripeCompactionPolicy.java


 Update documentation about major compaction algorithm
 -

 Key: HBASE-11120
 URL: https://issues.apache.org/jira/browse/HBASE-11120
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Affects Versions: 0.98.2
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 0.99.0

 Attachments: 11120_addendum.txt, HBASE-11120-2.patch, 
 HBASE-11120-3-rebased.patch, HBASE-11120-3.patch, 
 HBASE-11120-4-rebased.patch, HBASE-11120-4.patch, HBASE-11120.patch, 
 hbase-11120.addendum.patch


 [14:20:38]  jdcryans seems that there's 
 http://hbase.apache.org/book.html#compaction and 
 http://hbase.apache.org/book.html#managed.compactions
 [14:20:56]  jdcryans the latter doesn't say much, except that you 
 should manage them
 [14:21:44]  jdcryans the former gives a good description of the 
 _old_ selection algo
 [14:45:25]  jdcryans this is the new selection algo since C5 / 
 0.96.0: https://issues.apache.org/jira/browse/HBASE-7842



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11316) Expand info about compactions beyond HBASE-11120

2014-07-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078881#comment-14078881
 ] 

Hudson commented on HBASE-11316:


FAILURE: Integrated in HBase-TRUNK #5353 (See 
[https://builds.apache.org/job/HBase-TRUNK/5353/])
HBASE-11316 Expand info about compactions beyond HBASE-11120 ADDENDUM TO FIX 
BROKE TESTS (stack: rev 85853f69c88c08db61af7fb6ef3b5432f926e531)
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultCompactSelection.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestStripeCompactionPolicy.java


 Expand info about compactions beyond HBASE-11120
 

 Key: HBASE-11316
 URL: https://issues.apache.org/jira/browse/HBASE-11316
 Project: HBase
  Issue Type: Bug
  Components: Compaction, documentation
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 2.0.0

 Attachments: HBASE-11316-1.patch, HBASE-11316-2.patch, 
 HBASE-11316-3.patch, HBASE-11316-4.patch, HBASE-11316-5.patch, 
 HBASE-11316-6-rebased-v2.patch, HBASE-11316-6-rebased.patch, 
 HBASE-11316-6.patch, HBASE-11316-7.patch, HBASE-11316-8.patch, 
 HBASE-11316-9.patch, HBASE-11316.patch, addendum.txt, ch9_compactions.pdf


 Round 2 - expand info about the algorithms, talk about stripe compaction, and 
 talk more about configuration. Hopefully find some rules of thumb.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HBASE-11593) TestCacheConfig failing consistently in precommit builds

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-11593:
--

Resolution: Fixed
Status: Resolved  (was: Patch Available)

Resolving. Will reopen if see it again.

 TestCacheConfig failing consistently in precommit builds
 

 Key: HBASE-11593
 URL: https://issues.apache.org/jira/browse/HBASE-11593
 Project: HBase
  Issue Type: Bug
  Components: BlockCache
Reporter: Andrew Purtell
Assignee: stack
 Fix For: 0.99.0, 2.0.0

 Attachments: 11531v6.txt, 11593.txt, 11593v2.txt, 11593v3.txt, 
 11593v5.txt


 As stated in description



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (HBASE-10113) Consider consolidating DoubleBlockCache and CombinedBlockCache

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-10113.
---

Resolution: Won't Fix

DoubleBlockCache was removed. Resolving as won't fix.

 Consider consolidating DoubleBlockCache and CombinedBlockCache
 --

 Key: HBASE-10113
 URL: https://issues.apache.org/jira/browse/HBASE-10113
 Project: HBase
  Issue Type: Improvement
  Components: regionserver
Reporter: Nick Dimiduk
Priority: Minor

 DoubleBlockCache is a BlockCache that combines the LruBlockCache and 
 SlabCache. CombinedBlockCache that combines LruBlockCache and BucketCache. 
 These behaviors are (almost entirely) redundant. Consolidate the 
 implementations into a single implementation, or reduce code duplication.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (HBASE-7372) Check in the generated website so can point apache infrastructure at what to publish as our hbase.apache.org

2014-07-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-7372.
--

Resolution: Not a Problem

This works now.  Resolving.

 Check in the generated website so can point apache infrastructure at what to 
 publish as our hbase.apache.org
 

 Key: HBASE-7372
 URL: https://issues.apache.org/jira/browse/HBASE-7372
 Project: HBase
  Issue Type: Bug
Reporter: stack
Assignee: stack
 Attachments: 7372v2.txt


 January 1st is deadline for changing how we publish our website.  We may no 
 longer rsync out to people.apache.org.  Apache infrastructure supplies two 
 options here: http://www.apache.org/dev/project-site.html  We could redo our 
 site in apache cms format.  Or we could just use svnpubsub and keep on w/ how 
 the site is currently generated and on checkin, have it autopublished.  I'll 
 go the latter route unless I hear otherwise.
 For svnpubsub, we need to point apache infrastructure at a directory that has 
 our checkedin site in it.  I was thinking ${hbasedir}/hbase.apache.org
 Let me raise this on the dev list too.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HBASE-11607) Document HBase metrics

2014-07-29 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078906#comment-14078906
 ] 

Hadoop QA commented on HBASE-11607:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12658586/HBASE-11607.patch
  against trunk revision .
  ATTACHMENT ID: 12658586

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+0 tests included{color}.  The patch appears to be a 
documentation patch that doesn't require tests.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 lineLengths{color}.  The patch introduces the following lines 
longer than 100:
+
xlink:href=http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/metrics/package-summary.html;
+  
xlink:href=http://hadoop.apache.org/docs/current/api/org/apache/hadoop/metrics2/package-summary.html;
+
xlink:href=http://hadoop.apache.org/docs/current/api/org/apache/hadoop/metrics2/package-summary.html#filtering;
+  paraClick the guilabelMetrics Dump/guilabel link near the top. 
The metrics for the region serverare
+  paraBe sure the guilabelVisualVM-MBeans/guilabel plugin is 
installed. Browse to menuchoice

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   org.apache.hadoop.hbase.procedure.TestProcedureManager
  org.apache.hadoop.hbase.ipc.TestIPC
  org.apache.hadoop.hbase.master.TestClockSkewDetection

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/10222//console

This message is automatically generated.

 Document HBase metrics
 --

 Key: HBASE-11607
 URL: https://issues.apache.org/jira/browse/HBASE-11607
 Project: HBase
  Issue Type: Sub-task
  Components: documentation, metrics
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
  Labels: noob
 Attachments: HBASE-11607.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)