[jira] [Commented] (HBASE-12113) Backport HBASE-5525 to 0.94
[
https://issues.apache.org/jira/browse/HBASE-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151002#comment-14151002
]
Hadoop QA commented on HBASE-12113:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12671693/HBASE-12113-0.94.1.patch.txt
against trunk revision .
ATTACHMENT ID: 12671693
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/5//console
This message is automatically generated.
> Backport HBASE-5525 to 0.94
> ---
>
> Key: HBASE-12113
> URL: https://issues.apache.org/jira/browse/HBASE-12113
> Project: HBase
> Issue Type: Task
> Components: shell
>Affects Versions: 0.94.24
>Reporter: Sean Busbey
>Assignee: Sean Busbey
>Priority: Minor
> Attachments: HBASE-12113-0.94.1.patch.txt
>
>
> per [mailing
> list|http://mail-archives.apache.org/mod_mbox/hbase-user/201409.mbox/%3C1411880636.89071.YahooMailNeo%40web140604.mail.bf1.yahoo.com%3E]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151000#comment-14151000 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #519 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/519/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev 5c4f838447281c1a35e82c5154b9d127c30bdcbe) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150999#comment-14150999 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.98 #547 (See [https://builds.apache.org/job/HBase-0.98/547/]) HBASE-12090 Addendum (larsh: rev b3783d221a83819b4697b6763d6c45bd06620920) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150996#comment-14150996 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-1.0 #237 (See [https://builds.apache.org/job/HBase-1.0/237/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev ae65975426bbee43a35da8d6800ccc2c85bfe2ad) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12113) Backport HBASE-5525 to 0.94
[ https://issues.apache.org/jira/browse/HBASE-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-12113: Status: Patch Available (was: In Progress) > Backport HBASE-5525 to 0.94 > --- > > Key: HBASE-12113 > URL: https://issues.apache.org/jira/browse/HBASE-12113 > Project: HBase > Issue Type: Task > Components: shell >Affects Versions: 0.94.24 >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Minor > Attachments: HBASE-12113-0.94.1.patch.txt > > > per [mailing > list|http://mail-archives.apache.org/mod_mbox/hbase-user/201409.mbox/%3C1411880636.89071.YahooMailNeo%40web140604.mail.bf1.yahoo.com%3E] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12113) Backport HBASE-5525 to 0.94
[ https://issues.apache.org/jira/browse/HBASE-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-12113: Attachment: HBASE-12113-0.94.1.patch.txt Rebased the 0.94 patch from HBASE-5525 to current 0.94 branch, added trunk-addendum, manually tested in standalone way. > Backport HBASE-5525 to 0.94 > --- > > Key: HBASE-12113 > URL: https://issues.apache.org/jira/browse/HBASE-12113 > Project: HBase > Issue Type: Task > Components: shell >Affects Versions: 0.94.24 >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Minor > Attachments: HBASE-12113-0.94.1.patch.txt > > > per [mailing > list|http://mail-archives.apache.org/mod_mbox/hbase-user/201409.mbox/%3C1411880636.89071.YahooMailNeo%40web140604.mail.bf1.yahoo.com%3E] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150990#comment-14150990 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-0.94 #1423 (See [https://builds.apache.org/job/HBase-0.94/1423/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev baccf6c9d434132cc027fc9ed28d06aefc25db77) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150991#comment-14150991 ] Hudson commented on HBASE-11957: SUCCESS: Integrated in HBase-0.94-JDK7 #193 (See [https://builds.apache.org/job/HBase-0.94-JDK7/193/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev baccf6c9d434132cc027fc9ed28d06aefc25db77) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[
https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150988#comment-14150988
]
Hadoop QA commented on HBASE-12090:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12671686/HBASE-12090.ADD.patch
against trunk revision .
ATTACHMENT ID: 12671686
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
{color:red}-1 core zombie tests{color}. There are 6 zombie test(s):
at
org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles.testSimpleLoad(TestLoadIncrementalHFiles.java:100)
at
org.apache.hadoop.hbase.mapreduce.TestTableMapReduceBase.testMultiRegionTable(TestTableMapReduceBase.java:97)
at
org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles.testSimpleLoad(TestLoadIncrementalHFiles.java:99)
at
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.testMRIncrementalLoadWithSplit(TestHFileOutputFormat.java:360)
at
org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testSplitWhileBulkLoadPhase(TestLoadIncrementalHFilesSplitRecovery.java:339)
at
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2.testMRIncrementalLoadWithSplit(TestHFileOutputFormat2.java:361)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/4//console
This message is automatically generated.
> Bytes: more Unsafe, more Faster
>
>
> Key: HBASE-12090
> URL: https://issues.apache.org/jira/browse/HBASE-12090
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Affects Versions: 0.94.23, 0.98.6
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1
>
> Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch,
> HBASE-12090.ADD.patch, HBASE-12090.patch
>
>
> Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*:
> * New version of compareTo method.
> * New versions for primitive converters : putXXX/toXXX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150984#comment-14150984 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-1.0 #236 (See [https://builds.apache.org/job/HBase-1.0/236/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev b58c66d596d428a321fd0d981e14ed20c2c29787) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (HBASE-12113) Backport HBASE-5525 to 0.94
[ https://issues.apache.org/jira/browse/HBASE-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-12113 started by Sean Busbey. --- > Backport HBASE-5525 to 0.94 > --- > > Key: HBASE-12113 > URL: https://issues.apache.org/jira/browse/HBASE-12113 > Project: HBase > Issue Type: Task > Components: shell >Affects Versions: 0.94.24 >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Minor > > per [mailing > list|http://mail-archives.apache.org/mod_mbox/hbase-user/201409.mbox/%3C1411880636.89071.YahooMailNeo%40web140604.mail.bf1.yahoo.com%3E] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12113) Backport HBASE-5525 to 0.94
Sean Busbey created HBASE-12113: --- Summary: Backport HBASE-5525 to 0.94 Key: HBASE-12113 URL: https://issues.apache.org/jira/browse/HBASE-12113 Project: HBase Issue Type: Task Components: shell Affects Versions: 0.94.24 Reporter: Sean Busbey Assignee: Sean Busbey Priority: Minor per [mailing list|http://mail-archives.apache.org/mod_mbox/hbase-user/201409.mbox/%3C1411880636.89071.YahooMailNeo%40web140604.mail.bf1.yahoo.com%3E] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150980#comment-14150980 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-TRUNK #5568 (See [https://builds.apache.org/job/HBase-TRUNK/5568/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev dc5295df8c5288d29737cfe4d936a817c7a56e72) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150978#comment-14150978 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-0.94-security #535 (See [https://builds.apache.org/job/HBase-0.94-security/535/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev baccf6c9d434132cc027fc9ed28d06aefc25db77) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-9741) Remove hbase.regions.slop from hbase-default.xml
[
https://issues.apache.org/jira/browse/HBASE-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150977#comment-14150977
]
Ranjana Rajendran commented on HBASE-9741:
--
The test was written for the old balancer and took the default value in
defaults.xml which was 0.2f to prevent the stochastic balancer from searching
for a new base. With this value of 0.2f removed from defaults.xml, was then
taking the default value of 0.1f specified in the line ("float slop =
(float)UTIL.getConfiguration().getFloat("hbase.regions.slop", 0.1f);") which
made the test fail as this made the balancer search for a better fit which was
not the intention of this test.
I would like to understand why this test is required, i.e. why is this test
required to assert that regions are balanced using the function
assertRegionsAreBalanced() ? If this test need to be rewritten, I would like to
take up this task. Highly appreciate any input how to rewrite it different from
the patch above.
> Remove hbase.regions.slop from hbase-default.xml
>
>
> Key: HBASE-9741
> URL: https://issues.apache.org/jira/browse/HBASE-9741
> Project: HBase
> Issue Type: Bug
>Reporter: Elliott Clark
> Labels: beginner
> Attachments: HBASE-9741-v0.patch, HBASE-9741-v1.patch,
> HBASE-9741-v3.patch, HBASE-9741-v4.patch
>
>
> Different balancers have different slop default values. We should remove
> hbase.regions.slop from hbase-default.xml
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12075) Preemptive Fast Fail
[ https://issues.apache.org/jira/browse/HBASE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150971#comment-14150971 ] stack commented on HBASE-12075: --- [~manukranthk] It is tricky to find. We should make it easier by publishing the javadoc warnings in list of urls. To find the javadoc warnings, you need to navigate to the build artifacts for your patch build. Take one of the urls above and chop off the last bit as in take: https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html and remove the last bit to get https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/ You'll see a long list including javadoc warnings pages including this one https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/patchJavadocWarnings.txt Grep for WARNING Ignore the ones that are obviously not yours (e.g. the Unsafe WARNINGs) There seem to be some that belong to you if you keep grepping down... > Preemptive Fast Fail > > > Key: HBASE-12075 > URL: https://issues.apache.org/jira/browse/HBASE-12075 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju > Fix For: 1.0.0 > > Attachments: 0001-Add-a-test-case-for-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch > > > In multi threaded clients, we use a feature developed on 0.89-fb branch > called Preemptive Fast Fail. This allows the client threads which would > potentially fail, fail fast. The idea behind this feature is that we allow, > among the hundreds of client threads, one thread to try and establish > connection with the regionserver and if that succeeds, we mark it as a live > node again. Meanwhile, other threads which are trying to establish connection > to the same server would ideally go into the timeouts which is effectively > unfruitful. We can in those cases return appropriate exceptions to those > clients instead of letting them retry. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150970#comment-14150970 ] Hudson commented on HBASE-11957: SUCCESS: Integrated in HBase-0.94 #1422 (See [https://builds.apache.org/job/HBase-0.94/1422/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev 9f5c397e27c79124366041b3a93b49aa85abb2be) * src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150969#comment-14150969 ] Hudson commented on HBASE-11957: SUCCESS: Integrated in HBase-0.94-JDK7 #192 (See [https://builds.apache.org/job/HBase-0.94-JDK7/192/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev 9f5c397e27c79124366041b3a93b49aa85abb2be) * src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150963#comment-14150963 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-0.94-security #534 (See [https://builds.apache.org/job/HBase-0.94-security/534/]) HBASE-11957 addendum 2; fix TestAssignmentManager (larsh: rev 9f5c397e27c79124366041b3a93b49aa85abb2be) * src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-11339) HBase MOB
[ https://issues.apache.org/jira/browse/HBASE-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jiajia updated HBASE-11339: -- Attachment: MOB user guide_v5.docx change the method to enable mob feature. > HBase MOB > - > > Key: HBASE-11339 > URL: https://issues.apache.org/jira/browse/HBASE-11339 > Project: HBase > Issue Type: Umbrella > Components: regionserver, Scanners >Affects Versions: 2.0.0 >Reporter: Jingcheng Du >Assignee: Jingcheng Du > Fix For: hbase-11339 > > Attachments: HBase MOB Design-v2.pdf, HBase MOB Design-v3.pdf, HBase > MOB Design-v4.pdf, HBase MOB Design.pdf, MOB user guide.docx, MOB user > guide_v2.docx, MOB user guide_v3.docx, MOB user guide_v4.docx, MOB user > guide_v5.docx, hbase-11339-in-dev.patch > > > It's quite useful to save the medium binary data like images, documents > into Apache HBase. Unfortunately directly saving the binary MOB(medium > object) to HBase leads to a worse performance since the frequent split and > compaction. > In this design, the MOB data are stored in an more efficient way, which > keeps a high write/read performance and guarantees the data consistency in > Apache HBase. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150947#comment-14150947 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-TRUNK #5567 (See [https://builds.apache.org/job/HBase-TRUNK/5567/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev 5aeec324e77e5f57d1b641594764097878b25c5b) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150946#comment-14150946 ] Lars Hofhansl commented on HBASE-12090: --- Unfortunately committed with the wrong commit message. Oh well. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[
https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150942#comment-14150942
]
Hadoop QA commented on HBASE-12090:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12671681/12090-v3.txt
against trunk revision .
ATTACHMENT ID: 12671681
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:red}-1 findbugs{color}. The patch appears to cause Findbugs
(version 2.0.3) to fail.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.util.TestProcessBasedCluster
{color:red}-1 core zombie tests{color}. There are 3 zombie test(s):
at
org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache.testLoadAndDelete(TestSnapshotFileCache.java:89)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/3//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/3//console
This message is automatically generated.
> Bytes: more Unsafe, more Faster
>
>
> Key: HBASE-12090
> URL: https://issues.apache.org/jira/browse/HBASE-12090
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Affects Versions: 0.94.23, 0.98.6
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1
>
> Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch,
> HBASE-12090.ADD.patch, HBASE-12090.patch
>
>
> Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*:
> * New version of compareTo method.
> * New versions for primitive converters : putXXX/toXXX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-12090: -- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed addendum. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150936#comment-14150936 ] Lars Hofhansl commented on HBASE-11957: --- Pushed. Not happy. > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-11957: -- Attachment: 11957-addendum-2.txt 2nd addendum! Also needs a fix for TestAssignmentManager, which times out with this patch. > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum-2.txt, 11957-addendum.txt, > HBASE-5974-0.94-v1.diff, verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150934#comment-14150934 ] Lars Hofhansl commented on HBASE-12090: --- Ah, yes. Lemme commit the addendum. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150932#comment-14150932 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.94 #1421 (See [https://builds.apache.org/job/HBase-0.94/1421/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev b4e1be5b4095ef796961fc9194bd46a77ee224c0) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150929#comment-14150929 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.94-JDK7 #191 (See [https://builds.apache.org/job/HBase-0.94-JDK7/191/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev b4e1be5b4095ef796961fc9194bd46a77ee224c0) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150921#comment-14150921 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.98 #546 (See [https://builds.apache.org/job/HBase-0.98/546/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev 5c4f838447281c1a35e82c5154b9d127c30bdcbe) * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150918#comment-14150918 ] Hudson commented on HBASE-12090: FAILURE: Integrated in HBase-0.94-security #532 (See [https://builds.apache.org/job/HBase-0.94-security/532/]) HBASE-12090 Bytes: more Unsafe, more Faster. (Vladimir Rodionov) (larsh: rev b4e1be5b4095ef796961fc9194bd46a77ee224c0) * src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[
https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150912#comment-14150912
]
Vladimir Rodionov commented on HBASE-12090:
---
[~lhofhansl]
{quote}
Thanks Vladimir Rodionov!
{quote}
You are always welcome :)
> Bytes: more Unsafe, more Faster
>
>
> Key: HBASE-12090
> URL: https://issues.apache.org/jira/browse/HBASE-12090
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Affects Versions: 0.94.23, 0.98.6
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1
>
> Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch,
> HBASE-12090.ADD.patch, HBASE-12090.patch
>
>
> Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*:
> * New version of compareTo method.
> * New versions for primitive converters : putXXX/toXXX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov updated HBASE-12090: -- Attachment: HBASE-12090.ADD.patch > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov updated HBASE-12090: -- Status: Patch Available (was: Reopened) Small fix in toShort() to make sure that we are 100% bullet proof. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.98.6, 0.94.23 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.ADD.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov reopened HBASE-12090: --- Opened for addendum. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12075) Preemptive Fast Fail
[
https://issues.apache.org/jira/browse/HBASE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150909#comment-14150909
]
Hadoop QA commented on HBASE-12075:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12671680/0001-Implement-Preemptive-Fast-Fail.patch
against trunk revision .
ATTACHMENT ID: 12671680
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 8 new
or modified tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated 6
warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/2//console
This message is automatically generated.
> Preemptive Fast Fail
>
>
> Key: HBASE-12075
> URL: https://issues.apache.org/jira/browse/HBASE-12075
> Project: HBase
> Issue Type: Sub-task
> Components: Client
>Affects Versions: 1.0.0
>Reporter: Manukranth Kolloju
>Assignee: Manukranth Kolloju
> Fix For: 1.0.0
>
> Attachments: 0001-Add-a-test-case-for-Preemptive-Fast-Fail.patch,
> 0001-Implement-Preemptive-Fast-Fail.patch,
> 0001-Implement-Preemptive-Fast-Fail.patch,
> 0001-Implement-Preemptive-Fast-Fail.patch,
> 0001-Implement-Preemptive-Fast-Fail.patch
>
>
> In multi threaded clients, we use a feature developed on 0.89-fb branch
> called Preemptive Fast Fail. This allows the client threads which would
> potentially fail, fail fast. The idea behind this feature is that we allow,
> among the hundreds of client threads, one thread to try and establish
> connection with the regionserver and if that succeeds, we mark it as a live
> node again. Meanwhile, other threads which are trying to establish connection
> to the same server would ideally go into the timeouts which is effectively
> unfruitful. We can in those cases return appropriate exceptions to those
> clients instead of letting them retry.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[
https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150904#comment-14150904
]
Vladimir Rodionov commented on HBASE-12090:
---
Hey, I just found potential issue in the patch:
{code}
public static short toShort(byte[] bytes) {
return toShortUnsafe(bytes, 0);
}
{code}
If Unsafe is not available (have no idea if it is possible at all?) - the code
will fail.
> Bytes: more Unsafe, more Faster
>
>
> Key: HBASE-12090
> URL: https://issues.apache.org/jira/browse/HBASE-12090
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Affects Versions: 0.94.23, 0.98.6
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1
>
> Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch,
> HBASE-12090.patch
>
>
> Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*:
> * New version of compareTo method.
> * New versions for primitive converters : putXXX/toXXX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12040) Performances issues with FilteredScanTest
[
https://issues.apache.org/jira/browse/HBASE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150900#comment-14150900
]
stack commented on HBASE-12040:
---
I ran 5 funs of filteredScan and 5 of randomreads against 0.98 and then against
the 0.99.0 release. Seems like 0.99.0 is faster on filteredScan and about same
randomReading.
0.98
{code}
filterscan 265478ms over 100 rows
filterscan 246280ms over 100 rows
filterscan 245655ms over 100 rows
filterscan 245236ms over 100 rows
filterscan 246014ms over 100 rows
randomread 429293ms over 1048576 rows
randomread 397037ms over 1048576 rows
randomread 449759ms over 1048576 rows
randomread 442134ms over 1048576 rows
randomread 454600ms over 1048576 rows
{code}
0.99.0
{code}
filterscan 219691ms over 100 rows
filterscan 213598ms over 100 rows
filterscan 213214ms over 100 rows
filterscan 213116ms over 100 rows
filterscan 212634ms over 100 rows
randomread 453774ms over 1048576 rows
randomread 442692ms over 1048576 rows
randomread 390530ms over 1048576 rows
randomread 466790ms over 1048576 rows
randomread 449018ms over 1048576 rows
{code}
Let me compare w/o hbase-11331.
> Performances issues with FilteredScanTest
> --
>
> Key: HBASE-12040
> URL: https://issues.apache.org/jira/browse/HBASE-12040
> Project: HBase
> Issue Type: Bug
>Affects Versions: 0.99.1
>Reporter: Jean-Marc Spaggiari
>Assignee: stack
>Priority: Blocker
> Fix For: 0.98.7, 0.99.1
>
> Attachments: at-HBASE-11331.html, pre-HBASE-11331.html
>
>
> While testing 0.99.0RC1 release performances, compared to 0.98.6, figured
> that:
> - FilteredScanTest is 100 times slower;
> - RandomReadTest is 1.5 times slower;
> - RandomSeekScanTest is 3.2 times slower;
> - RandomScanWithRange10Test is 1,2 times slower;
> - RandomScanWithRange100Test is 1,3 times slower;
> - RandomScanWithRange1000Test is 4 times slower;
> - SequentialReadTest is 1,7 times slower;
> - SequentialWriteTest is just a bit faster;
> - RandomWriteTest is just a bit faster;
> - GaussianRandomReadBenchmark is just a beat slower;
> - SequentialReadBenchmark is 1,1 times slower;
> - SequentialWriteBenchmark is 1,1 times slower;
> - UniformRandomReadBenchmark crashed;
> - UniformRandomSmallScan is 1,3 times slower.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-12090: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to all branches. Left title the way it is :) Thanks [~vrodionov]! > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-12090: -- Attachment: 12090-v3.txt Patch with all the trailing whitespace fixed. > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, 12090-v3.txt, HBASE-12090.2.patch, > HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12075) Preemptive Fast Fail
[ https://issues.apache.org/jira/browse/HBASE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju updated HBASE-12075: --- Attachment: 0001-Implement-Preemptive-Fast-Fail.patch I can't seem to be able to find how to fix the javadoc warnings. Can someone help me with where to find the 6 warnings for javadoc are coming from ? If there is a script that needs to be run to find out those warnings, I'd be happy to run that as well :) > Preemptive Fast Fail > > > Key: HBASE-12075 > URL: https://issues.apache.org/jira/browse/HBASE-12075 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju > Fix For: 1.0.0 > > Attachments: 0001-Add-a-test-case-for-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch, > 0001-Implement-Preemptive-Fast-Fail.patch > > > In multi threaded clients, we use a feature developed on 0.89-fb branch > called Preemptive Fast Fail. This allows the client threads which would > potentially fail, fail fast. The idea behind this feature is that we allow, > among the hundreds of client threads, one thread to try and establish > connection with the regionserver and if that succeeds, we mark it as a live > node again. Meanwhile, other threads which are trying to establish connection > to the same server would ideally go into the timeouts which is effectively > unfruitful. We can in those cases return appropriate exceptions to those > clients instead of letting them retry. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12098) User granted namespace table create permissions can't create a table
[
https://issues.apache.org/jira/browse/HBASE-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150825#comment-14150825
]
Andrew Purtell commented on HBASE-12098:
This is a bug fix I think. We don't need to flag it or document it as an
incompatible change. Should have always worked this way. We also had an issue
earlier where group permissions should have been checked on namespaces and were
not. Same class of problem.
+1
> User granted namespace table create permissions can't create a table
>
>
> Key: HBASE-12098
> URL: https://issues.apache.org/jira/browse/HBASE-12098
> Project: HBase
> Issue Type: Bug
> Components: Client, security
>Affects Versions: 0.98.6
>Reporter: Dima Spivak
>Assignee: Srikanth Srungarapu
>Priority: Critical
> Fix For: 2.0.0, 0.98.7, 0.99.1
>
> Attachments: 12098-master.txt, HBASE-12098.patch,
> HBASE-12098_master_v2.patch
>
>
> From the HBase shell and Java API, I am seeing
> {code}ERROR: org.apache.hadoop.hbase.security.AccessDeniedException:
> Insufficient permissions for user 'dima' (global, action=CREATE){code}
> when I try to create a table in a namespace to which I have been granted
> RWXCA permissions by a global admin. Interestingly enough, this only seems to
> extend to table creation; the same user is then allowed to disable and drop a
> table created by a global admin in that namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12052) BulkLoad Failed due to no write permission on input files
[
https://issues.apache.org/jira/browse/HBASE-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150824#comment-14150824
]
Andrew Purtell commented on HBASE-12052:
This functionality in particular could be folded into core without difficultly.
Shall we file a follow up issue to do it?
> BulkLoad Failed due to no write permission on input files
> -
>
> Key: HBASE-12052
> URL: https://issues.apache.org/jira/browse/HBASE-12052
> Project: HBase
> Issue Type: Bug
>Affects Versions: 0.99.0, 0.98.6
>Reporter: Jeffrey Zhong
>Assignee: Jeffrey Zhong
> Fix For: 0.98.7, 0.99.1
>
> Attachments: HBASE-12052.patch
>
>
> The issue is that HBase bulkload is done by Region Server which normally runs
> under hbase user while the input hfile folder & the user starts the bulkload
> could be any user.
> Below is the error message when user "hrt_qa" bulkload files which "hrt_qa"
> has the write permission while the bulkload operation still fail with
> "Permission denied" error.
> We had similar handling for this issue in secure env so the proposed fix is
> to reuse SecureBulkLoadEndPoint in un-secure env as well. In the future, we
> can rename the class to BulkLoadEndPoint.
> {noformat}
> java.io.IOException: Exception in rename
> at
> org.apache.hadoop.hbase.regionserver.HRegionFileSystem.rename(HRegionFileSystem.java:947)
> at
> org.apache.hadoop.hbase.regionserver.HRegionFileSystem.commitStoreFile(HRegionFileSystem.java:347)
> at
> org.apache.hadoop.hbase.regionserver.HRegionFileSystem.bulkLoadStoreFile(HRegionFileSystem.java:421)
> at
> org.apache.hadoop.hbase.regionserver.HStore.bulkLoadHFile(HStore.java:723)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3603)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3525)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFile(HRegionServer.java:3276)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28863)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92)
> at
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160)
> at
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38)
> at
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.hadoop.security.AccessControlException: Permission
> denied: user=hbase, access=WRITE,
> inode="/tmp/a0f3ee35-4c8f-4077-93d0-94d8e5bae914/0":hrt_qa:hdfs:drwxr-xr-x
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:179)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5515)
> {noformat}
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12040) Performances issues with FilteredScanTest
[ https://issues.apache.org/jira/browse/HBASE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150763#comment-14150763 ] Jean-Marc Spaggiari commented on HBASE-12040: - Sorry, I was sick the last few days so not active, always sleeping :( I'm back. Let me retry few different versions and post the results here. Should have more numbers by tomorrow. > Performances issues with FilteredScanTest > -- > > Key: HBASE-12040 > URL: https://issues.apache.org/jira/browse/HBASE-12040 > Project: HBase > Issue Type: Bug >Affects Versions: 0.99.1 >Reporter: Jean-Marc Spaggiari >Assignee: stack >Priority: Blocker > Fix For: 0.98.7, 0.99.1 > > Attachments: at-HBASE-11331.html, pre-HBASE-11331.html > > > While testing 0.99.0RC1 release performances, compared to 0.98.6, figured > that: > - FilteredScanTest is 100 times slower; > - RandomReadTest is 1.5 times slower; > - RandomSeekScanTest is 3.2 times slower; > - RandomScanWithRange10Test is 1,2 times slower; > - RandomScanWithRange100Test is 1,3 times slower; > - RandomScanWithRange1000Test is 4 times slower; > - SequentialReadTest is 1,7 times slower; > - SequentialWriteTest is just a bit faster; > - RandomWriteTest is just a bit faster; > - GaussianRandomReadBenchmark is just a beat slower; > - SequentialReadBenchmark is 1,1 times slower; > - SequentialWriteBenchmark is 1,1 times slower; > - UniformRandomReadBenchmark crashed; > - UniformRandomSmallScan is 1,3 times slower. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12034) If I kill single RS in branch-1, all regions end up on Master!
[ https://issues.apache.org/jira/browse/HBASE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150742#comment-14150742 ] Jimmy Xiang commented on HBASE-12034: - The first patch for branch 1 is on RB: https://reviews.apache.org/r/26116/ > If I kill single RS in branch-1, all regions end up on Master! > -- > > Key: HBASE-12034 > URL: https://issues.apache.org/jira/browse/HBASE-12034 > Project: HBase > Issue Type: Bug > Components: master >Reporter: stack >Assignee: Jimmy Xiang >Priority: Critical > Fix For: 0.99.1 > > Attachments: hbase-12034_1.patch, hbase-12034_2.patch > > > This is unexpected. M should not be carrying regions in branch-1. Right > [~jxiang]? Thanks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12034) If I kill single RS in branch-1, all regions end up on Master!
[ https://issues.apache.org/jira/browse/HBASE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150717#comment-14150717 ] Jimmy Xiang commented on HBASE-12034: - These tests are ok on my box. > If I kill single RS in branch-1, all regions end up on Master! > -- > > Key: HBASE-12034 > URL: https://issues.apache.org/jira/browse/HBASE-12034 > Project: HBase > Issue Type: Bug > Components: master >Reporter: stack >Assignee: Jimmy Xiang >Priority: Critical > Fix For: 0.99.1 > > Attachments: hbase-12034_1.patch, hbase-12034_2.patch > > > This is unexpected. M should not be carrying regions in branch-1. Right > [~jxiang]? Thanks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12090) Bytes: more Unsafe, more Faster
[ https://issues.apache.org/jira/browse/HBASE-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150657#comment-14150657 ] Andrew Purtell commented on HBASE-12090: +1 > Bytes: more Unsafe, more Faster > > > Key: HBASE-12090 > URL: https://issues.apache.org/jira/browse/HBASE-12090 > Project: HBase > Issue Type: Improvement > Components: Performance >Affects Versions: 0.94.23, 0.98.6 >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1 > > Attachments: 12090-v1.1.txt, HBASE-12090.2.patch, HBASE-12090.patch > > > Additional optimizations to *org.apache.hadoop.hbase.util.Bytes*: > * New version of compareTo method. > * New versions for primitive converters : putXXX/toXXX. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11964) Improve spreading replication load from failed regionservers
[ https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150655#comment-14150655 ] Andrew Purtell commented on HBASE-11964: Repeating the above question. Any comment? Otherwise I say lets make the change in master and branch-1 > Improve spreading replication load from failed regionservers > > > Key: HBASE-11964 > URL: https://issues.apache.org/jira/browse/HBASE-11964 > Project: HBase > Issue Type: Sub-task >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25 > > Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, > HBASE-11964.patch, HBASE-11964.patch > > > Improve replication source thread handling. Improve fanout when transferring > queues. Ensure replication sources terminate properly. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12111) Remove deprecated APIs from Mutation(s)
[ https://issues.apache.org/jira/browse/HBASE-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-12111: --- Attachment: HBASE-12111.patch Same patch for a QA run. > Remove deprecated APIs from Mutation(s) > --- > > Key: HBASE-12111 > URL: https://issues.apache.org/jira/browse/HBASE-12111 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Anoop Sam John >Assignee: Anoop Sam John > Fix For: 2.0.0 > > Attachments: HBASE-12111.patch, HBASE-12111.patch > > > Mutation setWriteToWAL(boolean) > boolean getWriteToWAL() > Mutation setFamilyMap(NavigableMap>) > NavigableMap> getFamilyMap() > To be removed from Mutation and the setters from Put/Delete/Increment/Append > as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12111) Remove deprecated APIs from Mutation(s)
[ https://issues.apache.org/jira/browse/HBASE-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-12111: --- Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change) Status: Patch Available (was: Open) > Remove deprecated APIs from Mutation(s) > --- > > Key: HBASE-12111 > URL: https://issues.apache.org/jira/browse/HBASE-12111 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Anoop Sam John >Assignee: Anoop Sam John > Fix For: 2.0.0 > > Attachments: HBASE-12111.patch, HBASE-12111.patch > > > Mutation setWriteToWAL(boolean) > boolean getWriteToWAL() > Mutation setFamilyMap(NavigableMap>) > NavigableMap> getFamilyMap() > To be removed from Mutation and the setters from Put/Delete/Increment/Append > as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12111) Remove deprecated APIs from Mutation(s)
[ https://issues.apache.org/jira/browse/HBASE-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-12111: --- Status: Open (was: Patch Available) > Remove deprecated APIs from Mutation(s) > --- > > Key: HBASE-12111 > URL: https://issues.apache.org/jira/browse/HBASE-12111 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Anoop Sam John >Assignee: Anoop Sam John > Fix For: 2.0.0 > > Attachments: HBASE-12111.patch > > > Mutation setWriteToWAL(boolean) > boolean getWriteToWAL() > Mutation setFamilyMap(NavigableMap>) > NavigableMap> getFamilyMap() > To be removed from Mutation and the setters from Put/Delete/Increment/Append > as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12112) Avoid KeyValueUtil#ensureKeyValue some more simple cases
[ https://issues.apache.org/jira/browse/HBASE-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150641#comment-14150641 ] Anoop Sam John commented on HBASE-12112: bq.In CellComparator is there something that does the below? If not, should we add it? Yes. Thanks.. I can use it. That will be better. bq.ClonedSeekerState is serializing same way KV did? that is why the heapsize calc works? The fixed over head is different from KV. The dynamic part is the lengths of individual components bq. Are we perpetuating the old KV serialization surrepticiously here? It is just used in some Exception messages and toString impls. I think better we can change these places to have some thing like rk : cf: q: ts type message. No need to create the key as it would look like in KV. I was just trying to be like the old way. I can chage. Sounds good? bq.This thing is kinda crazy cellToStringMap (Its not you, you are just replacing what was there). Is that necessary? Again was trying to be like the old way. This is used by toJSON() and you can see Scan/Get etc also implements it with adding their details. I think we can continue to have this. > Avoid KeyValueUtil#ensureKeyValue some more simple cases > > > Key: HBASE-12112 > URL: https://issues.apache.org/jira/browse/HBASE-12112 > Project: HBase > Issue Type: Sub-task > Components: regionserver >Reporter: Anoop Sam John >Assignee: Anoop Sam John > Fix For: 2.0.0, 0.99.1 > > Attachments: HBASE-12112.patch > > > This include fixes with > - Replace KeyValue#heapSize() with CellUtil#estimatedHeapSizeOf(Cell) > - Printing the key portion of a cell (rk+cf+q+ts+type). These are in > Exception messages > - HFilePrettyPrinter - Avoiding ensureKeyValue() calls and calls to > cell#getxxx() which involves bytes copying. This is not a hot area still we > can avoid as much usage of deprecated methods as possible in core code. I > believe these bytes copying methods are used in many other parts and later we > can try fixing those as per area importance > - Creating CellUtil#createKeyOnlyCell and using that in KeyOnlyFilter -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150487#comment-14150487 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-0.94-JDK7 #190 (See [https://builds.apache.org/job/HBase-0.94-JDK7/190/]) HBASE-11957 Addendum; fix TestMetaReaderEditorNoCluster (larsh: rev 66cfcbe1532261f42524e8e02e762007ef0796a3) * src/test/java/org/apache/hadoop/hbase/catalog/TestMetaReaderEditorNoCluster.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum.txt, HBASE-5974-0.94-v1.diff, > verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12099) TestScannerModel fails if using jackson 1.9.13
[
https://issues.apache.org/jira/browse/HBASE-12099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150474#comment-14150474
]
Hadoop QA commented on HBASE-12099:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12671622/12099-2.txt
against trunk revision .
ATTACHMENT ID: 12671622
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.client.TestMultiParallel
org.apache.hadoop.hbase.util.TestProcessBasedCluster
org.apache.hadoop.hbase.mapreduce.TestImportExport
{color:red}-1 core zombie tests{color}. There are 2 zombie test(s):
at
org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testSplitWhileBulkLoadPhase(TestLoadIncrementalHFilesSplitRecovery.java:339)
at
org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles.testSimpleLoad(TestLoadIncrementalHFiles.java:100)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/0//console
This message is automatically generated.
> TestScannerModel fails if using jackson 1.9.13
> --
>
> Key: HBASE-12099
> URL: https://issues.apache.org/jira/browse/HBASE-12099
> Project: HBase
> Issue Type: Bug
> Components: REST
>Affects Versions: 2.0.0, 0.98.7, 0.99.1
> Environment: hadoop-2.5.0
>Reporter: Esteban Gutierrez
>Assignee: Esteban Gutierrez
> Attachments: 12099-1.txt, 12099-2.txt, HBASE-12099.v0.txt
>
>
> TestScannerModel fails if jackson 1.9.13 is used. (Hadoop 2.5 now uses that
> version, see HADOOP-10104):
> {code}
> Failed tests:
> testToJSON(org.apache.hadoop.hbase.rest.model.TestScannerModel):
> expected:<{"batch":100,"caching":1000,"cacheBlocks":false,"endRow":"enp5eng=","endTime":1245393318192,"maxVersions":2147483647,"startRow":"YWJyYWNhZGFicmE=","startTime":1245219839331,"column":["Y29sdW1uMQ==","Y29sdW1uMjpmb28="],"labels":["private","public"]}>
> but
> was:<{"startRow":"YWJyYWNhZGFicmE=","endRow":"enp5eng=","batch":100,"startTime":1245219839331,"endTime":1245393318192,"maxVersions":2147483647,"caching":1000,"cacheBlocks":false,"column":["Y29sdW1uMQ==","Y29sdW1uMjpmb28="],"label":["private","public"]}>
> {code}
> The problem is the annotatio
[jira] [Commented] (HBASE-11957) Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[ https://issues.apache.org/jira/browse/HBASE-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150472#comment-14150472 ] Hudson commented on HBASE-11957: FAILURE: Integrated in HBase-0.94-security #531 (See [https://builds.apache.org/job/HBase-0.94-security/531/]) HBASE-11957 Addendum; fix TestMetaReaderEditorNoCluster (larsh: rev 66cfcbe1532261f42524e8e02e762007ef0796a3) * src/test/java/org/apache/hadoop/hbase/catalog/TestMetaReaderEditorNoCluster.java > Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() > seems incorrect > - > > Key: HBASE-11957 > URL: https://issues.apache.org/jira/browse/HBASE-11957 > Project: HBase > Issue Type: Bug >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Critical > Fix For: 0.94.24 > > Attachments: 11957-addendum.txt, HBASE-5974-0.94-v1.diff, > verify-test.patch > > > HBASE-5974:Scanner retry behavior with RPC timeout on next() seems incorrect, > which cause data missing in hbase scan. > I think we should fix it in 0.94. > [~lhofhansl] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
