[jira] [Commented] (HBASE-13347) RowCounter using special filter is broken
[
https://issues.apache.org/jira/browse/HBASE-13347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984355#comment-14984355
]
Frank Chang commented on HBASE-13347:
-
I'm tried to use
https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java
code and package a new jar then excuted following shell script:
{code:none}
hadoop jar test.jar --range=row001,row002 cf:c2
{code}
Then I got "NoSuchColumnFamilyException".
Is that normally?
And I tried to add
{code:java}
continue;
{code}
after #L123 to avoid "--range=*" string be appended to qualifer.
Then the problem seems solve.
--
data in table:
||row||cf:c1||cf:c2||cf:c3||cf:c4||
|row001|v1|v2| | |
|row002| |v2|v3| |
|row003| | |v3|v4|
|row004|v1| | |v4|
Exception Message:
{code:java}
org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException:
org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family
--range=row001,row002 does not exist in region
frank_rowcounttest1,,1446191360354.6c52c71a82f0fa041c467002a2bf433c. in table
'frank_rowcounttest1', {NAME => 'cf', DATA_BLOCK_ENCODING => 'NONE',
BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS
=> '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
{code}
> RowCounter using special filter is broken
> -
>
> Key: HBASE-13347
> URL: https://issues.apache.org/jira/browse/HBASE-13347
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Affects Versions: 1.0.0
>Reporter: Lars George
> Fix For: 2.0.0, 1.3.0, 1.2.1, 1.0.3, 1.1.4
>
>
> The {{RowCounter}} in the {{mapreduce}} package is supposed to check if the
> row count scan has a column selection added to it, and if so, use a different
> filter that finds the row and counts it. But the {{qualifier.add()}} call is
> missing in the {{for}} loop. See
> https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java#L165
> Needs fixing or row count might be wrong when using {{--range}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-11393) Replication TableCfs should be a PB object rather than a string
[ https://issues.apache.org/jira/browse/HBASE-11393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-11393: -- Attachment: HBASE-11393_v5.patch > Replication TableCfs should be a PB object rather than a string > --- > > Key: HBASE-11393 > URL: https://issues.apache.org/jira/browse/HBASE-11393 > Project: HBase > Issue Type: Sub-task >Reporter: Enis Soztutar > Fix For: 2.0.0 > > Attachments: HBASE-11393.patch, HBASE-11393_v1.patch, > HBASE-11393_v2.patch, HBASE-11393_v3.patch, HBASE-11393_v4.patch, > HBASE-11393_v5.patch > > > We concatenate the list of tables and column families in format > "table1:cf1,cf2;table2:cfA,cfB" in zookeeper for table-cf to replication peer > mapping. > This results in ugly parsing code. We should do this a PB object. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11393) Replication TableCfs should be a PB object rather than a string
[
https://issues.apache.org/jira/browse/HBASE-11393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984316#comment-14984316
]
Hadoop QA commented on HBASE-11393:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12769979/HBASE-11393_v5.patch
against master branch at commit 6cc6d833f2cde47123876e5ca107b522004055ac.
ATTACHMENT ID: 12769979
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.6.1 2.7.0
2.7.1)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:red}-1 checkstyle{color}. The applied patch generated
1735 checkstyle errors (more than the master's current 1730 errors).
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
org.apache.hadoop.hbase.replication.TestPerTableCFReplication
org.apache.hadoop.hbase.client.replication.TestReplicationAdmin
org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/16337//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/16337//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/16337//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/16337//console
This message is automatically generated.
> Replication TableCfs should be a PB object rather than a string
> ---
>
> Key: HBASE-11393
> URL: https://issues.apache.org/jira/browse/HBASE-11393
> Project: HBase
> Issue Type: Sub-task
>Reporter: Enis Soztutar
> Fix For: 2.0.0
>
> Attachments: HBASE-11393.patch, HBASE-11393_v1.patch,
> HBASE-11393_v2.patch, HBASE-11393_v3.patch, HBASE-11393_v4.patch,
> HBASE-11393_v5.patch
>
>
> We concatenate the list of tables and column families in format
> "table1:cf1,cf2;table2:cfA,cfB" in zookeeper for table-cf to replication peer
> mapping.
> This results in ugly parsing code. We should do this a PB object.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14711) Remove or annotated deprecated methods in HRegionInfo
[ https://issues.apache.org/jira/browse/HBASE-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hsieh updated HBASE-14711: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks for the review matteo. committed to master/2.0 > Remove or annotated deprecated methods in HRegionInfo > - > > Key: HBASE-14711 > URL: https://issues.apache.org/jira/browse/HBASE-14711 > Project: HBase > Issue Type: Bug > Components: hbase >Affects Versions: 2.0.0 >Reporter: Jonathan Hsieh >Assignee: Jonathan Hsieh > Fix For: 2.0.0 > > Attachments: hbase-14711.patch, hbase-14711.v2.patch, > hbase-14711.v3.patch, hbase-14711.v4.patch > > > Several methods were deprecated in 1.0 and moved to MetaTableAccessor. This > removes them from the 2.0 branch and converts them to the MetaTableAccessor. > HRegionInfo#getComparator was marked deprecated after 1.0 so needs to > remain. (HBASE-13501) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14711) Remove or annotated deprecated methods in HRegionInfo
[ https://issues.apache.org/jira/browse/HBASE-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984428#comment-14984428 ] Hudson commented on HBASE-14711: FAILURE: Integrated in HBase-Trunk_matrix #419 (See [https://builds.apache.org/job/HBase-Trunk_matrix/419/]) HBASE-14711 Remove or annotate deprecated methods in HRegionInfo (jmhsieh: rev 4c25549e9f270ecef6c13bff8f46cef68bf5ba56) * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRebuildTestCore.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/Merge.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterOperationsForRegionReplicas.java * hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaTableAccessorNoCluster.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterTransitions.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java > Remove or annotated deprecated methods in HRegionInfo > - > > Key: HBASE-14711 > URL: https://issues.apache.org/jira/browse/HBASE-14711 > Project: HBase > Issue Type: Bug > Components: hbase >Affects Versions: 2.0.0 >Reporter: Jonathan Hsieh >Assignee: Jonathan Hsieh > Fix For: 2.0.0 > > Attachments: hbase-14711.patch, hbase-14711.v2.patch, > hbase-14711.v3.patch, hbase-14711.v4.patch > > > Several methods were deprecated in 1.0 and moved to MetaTableAccessor. This > removes them from the 2.0 branch and converts them to the MetaTableAccessor. > HRegionInfo#getComparator was marked deprecated after 1.0 so needs to > remain. (HBASE-13501) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14733) Minor typo in alter_namespace.rb
[
https://issues.apache.org/jira/browse/HBASE-14733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984450#comment-14984450
]
Hudson commented on HBASE-14733:
FAILURE: Integrated in HBase-0.98-matrix #254 (See
[https://builds.apache.org/job/HBase-0.98-matrix/254/])
HBASE-14733 Minor typo in alter_namespace.rb (enis: rev
7bc22570b1fd35883a654ebfc2e3752a8ee46eaa)
* hbase-shell/src/main/ruby/shell/commands/create_namespace.rb
* hbase-shell/src/main/ruby/shell/commands/alter_namespace.rb
> Minor typo in alter_namespace.rb
>
>
> Key: HBASE-14733
> URL: https://issues.apache.org/jira/browse/HBASE-14733
> Project: HBase
> Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
>Priority: Trivial
> Fix For: 2.0.0, 1.2.0, 1.3.0, 1.0.3, 1.1.3, 0.98.16
>
> Attachments: hbase-14733.patch
>
>
> {code}
> diff --git hbase-shell/src/main/ruby/shell/commands/alter_namespace.rb
> hbase-shell/src/main/ruby/shell/commands/alter_namespace.rb
> index 760bbf7..a16e10d 100644
> --- hbase-shell/src/main/ruby/shell/commands/alter_namespace.rb
> +++ hbase-shell/src/main/ruby/shell/commands/alter_namespace.rb
> @@ -26,11 +26,11 @@ Alter namespace properties.
>
> To add/modify a property:
>
> - hbase> alter_namespace 'ns1', {METHOD => 'set', 'PROERTY_NAME' =>
> 'PROPERTY_VALUE'}
> + hbase> alter_namespace 'ns1', {METHOD => 'set', 'PROPERTY_NAME' =>
> 'PROPERTY_VALUE'}
>
> To delete a property:
>
> - hbase> alter_namespace 'ns1', {METHOD => 'unset', NAME=>'PROERTY_NAME'}
> + hbase> alter_namespace 'ns1', {METHOD => 'unset', NAME=>'PROPERTY_NAME'}
> EOF
>end
>
> diff --git hbase-shell/src/main/ruby/shell/commands/create_namespace.rb
> hbase-shell/src/main/ruby/shell/commands/create_namespace.rb
> index 3259eb6..adb6897 100644
> --- hbase-shell/src/main/ruby/shell/commands/create_namespace.rb
> +++ hbase-shell/src/main/ruby/shell/commands/create_namespace.rb
> @@ -27,7 +27,7 @@ and optionally a dictionary of namespace configuration.
> Examples:
>
>hbase> create_namespace 'ns1'
> - hbase> create_namespace 'ns1', {'PROERTY_NAME'=>'PROPERTY_VALUE'}
> + hbase> create_namespace 'ns1', {'PROPERTY_NAME'=>'PROPERTY_VALUE'}
> EOF
>end
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (HBASE-14679) Separate security shell tests from other shell tests
[ https://issues.apache.org/jira/browse/HBASE-14679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14679. Resolution: Won't Fix Investigation on TestShell is needed. Resolving. > Separate security shell tests from other shell tests > > > Key: HBASE-14679 > URL: https://issues.apache.org/jira/browse/HBASE-14679 > Project: HBase > Issue Type: Task >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 14679-branch-1-v1.txt, 14679-branch-1-v1.txt > > > TestShell takes a long time to run, sometimes timing out (especially on > branch-1). > This issue proposes the following changes: > separate security shell tests into their own test class > use unique table names for different tests -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14738) Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98
[ https://issues.apache.org/jira/browse/HBASE-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-14738: --- Release Note: Checksumming is cpu intensive. HBase computes additional checksums for HFiles (hdfs does checksums too) and stores them inline with file data. During reading, these checksums are verified to ensure data is not corrupted. This patch tries to use Hadoop Native Library for checksum computation, if it’s available, otherwise falls back to standard Java libraries. Instructions to load NHL in HBase can be found here (http://hbase.apache.org/book.html#hadoop.native.lib). Default checksum algorithm remains CRC32. The CRC32C is better because of two reasons: 1) CRC32C has better error detection properties, and 2) New Intel processors have a dedicated instruction for crc32c computation (SSE4.2 instruction set)*. This change is fully backward compatible. Also, users should not see any differences except decrease in cpu usage. To use CRC32C, set configuration ‘hbase.hstore.checksum.algorithm’ to ‘CRC32C’. * On linux, run 'cat /proc/cpuinfo’ and look for sse4_2 in list of flags to see if your processor supports SSE4.2. > Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98 > --- > > Key: HBASE-14738 > URL: https://issues.apache.org/jira/browse/HBASE-14738 > Project: HBase > Issue Type: Task >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 0.98.16 > > > Profiling 0.98.15 I see 20-30% of CPU time spent in Hadoop's PureJavaCrc32. > Not surprising given previous results described on HBASE-11927. Backport. > There are two issues with the backport: > # The patch on 11927 changes the default CRC type from CRC32 to CRC32C. > Although the changes are backwards compatible -files with either CRC type > will be handled correctly in a transparent manner - we should probably leave > the default alone in 0.98 and advise users on a site configuration change to > use CRC32C if desired, for potential hardware acceleration. > # Need a shim for differences between Hadoop's DataChecksum type. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
[ https://issues.apache.org/jira/browse/HBASE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14739: Attachment: HBASE-14739.patch > Fix broken link to Javadoc that is suppressed because it is generated code > --- > > Key: HBASE-14739 > URL: https://issues.apache.org/jira/browse/HBASE-14739 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-14739.patch > > > We no longer build Javadoc of generated code. There was a manual link to a > generated API referenced in a package-summary.html. Remove that. Also clean > up a few trailing spaces in the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14732) Update HBase website skin and CSS
[
https://issues.apache.org/jira/browse/HBASE-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984598#comment-14984598
]
Hadoop QA commented on HBASE-14732:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12770009/HBASE-14732-v1.patch
against master branch at commit 4c25549e9f270ecef6c13bff8f46cef68bf5ba56.
ATTACHMENT ID: 12770009
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+0 tests included{color}. The patch appears to be a
documentation patch that doesn't require tests.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/16339//console
This message is automatically generated.
> Update HBase website skin and CSS
> -
>
> Key: HBASE-14732
> URL: https://issues.apache.org/jira/browse/HBASE-14732
> Project: HBase
> Issue Type: Task
> Components: documentation
>Reporter: Misty Stanley-Jones
>Assignee: Misty Stanley-Jones
> Fix For: 2.0.0
>
> Attachments: HBASE-14732-v1.patch, HBASE-14732.patch
>
>
> Use Fluido skin, make things more readable, make improvements to enhance the
> mobile experience.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14732) Update HBase website skin and CSS
[ https://issues.apache.org/jira/browse/HBASE-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14732: Status: Open (was: Patch Available) > Update HBase website skin and CSS > - > > Key: HBASE-14732 > URL: https://issues.apache.org/jira/browse/HBASE-14732 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14732-v1.patch, HBASE-14732.patch > > > Use Fluido skin, make things more readable, make improvements to enhance the > mobile experience. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14732) Update HBase website skin and CSS
[ https://issues.apache.org/jira/browse/HBASE-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14732: Status: Patch Available (was: Open) > Update HBase website skin and CSS > - > > Key: HBASE-14732 > URL: https://issues.apache.org/jira/browse/HBASE-14732 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14732-v1.patch, HBASE-14732.patch > > > Use Fluido skin, make things more readable, make improvements to enhance the > mobile experience. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14532) [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config and not described in section 7
[ https://issues.apache.org/jira/browse/HBASE-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984709#comment-14984709 ] Ted Yu commented on HBASE-14532: lgtm > [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config > and not described in section 7 > - > > Key: HBASE-14532 > URL: https://issues.apache.org/jira/browse/HBASE-14532 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Rick Moritz >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-14532-v1.patch, HBASE-14532.patch > > > After trying to figure out whether shortcircuit reads would work on my > system, I studied the book and found conflicting information. > It's suggested in section 92.2, that dfs.client.read.shortcircuit is an > option in hbase-site.xml, but the supposedly complete default configuration > in section 7 does not include this setting. This leads to confusion on > whether it's sufficient to enable this setting in hdfs-site.xml, or whether > it needs to be added to both configurations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14532) [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config and not described in section 7
[ https://issues.apache.org/jira/browse/HBASE-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14532: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master. > [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config > and not described in section 7 > - > > Key: HBASE-14532 > URL: https://issues.apache.org/jira/browse/HBASE-14532 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Rick Moritz >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-14532-v1.patch, HBASE-14532.patch > > > After trying to figure out whether shortcircuit reads would work on my > system, I studied the book and found conflicting information. > It's suggested in section 92.2, that dfs.client.read.shortcircuit is an > option in hbase-site.xml, but the supposedly complete default configuration > in section 7 does not include this setting. This leads to confusion on > whether it's sufficient to enable this setting in hdfs-site.xml, or whether > it needs to be added to both configurations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14706) RegionLocationFinder should return multiple servername by top host
[
https://issues.apache.org/jira/browse/HBASE-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guanghao Zhang updated HBASE-14706:
---
Attachment: HBASE-14706-trunk_v3.patch
> RegionLocationFinder should return multiple servername by top host
> --
>
> Key: HBASE-14706
> URL: https://issues.apache.org/jira/browse/HBASE-14706
> Project: HBase
> Issue Type: Bug
> Components: Balancer
>Affects Versions: 2.0.0, 1.2.0, 1.3.0
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-14706-trunk_v1.patch, HBASE-14706-trunk_v2.patch,
> HBASE-14706-trunk_v3.patch, HBASE-14706.patch
>
>
> Multiple RS can run on the same host. But in current RegionLocationFinder,
> mapHostNameToServerName map one host to only one server. This will make
> LocalityCostFunction get wrong locality about region.
> {code}
> // create a mapping from hostname to ServerName for fast lookup
> HashMap hostToServerName = new HashMap ServerName>();
> for (ServerName sn : regionServers) {
> hostToServerName.put(sn.getHostname(), sn);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14641) Move JDO example from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14641: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master. > Move JDO example from Wiki to Ref Guide > --- > > Key: HBASE-14641 > URL: https://issues.apache.org/jira/browse/HBASE-14641 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14641-v1.patch, HBASE-14641.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HBASE-14481) Decommission HBase wiki
[ https://issues.apache.org/jira/browse/HBASE-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones reassigned HBASE-14481: --- Assignee: Misty Stanley-Jones > Decommission HBase wiki > --- > > Key: HBASE-14481 > URL: https://issues.apache.org/jira/browse/HBASE-14481 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Nick Dimiduk >Assignee: Misty Stanley-Jones >Priority: Blocker > Labels: beginner > Fix For: 2.0.0 > > > We have an awesome community resource in our [online > book|http://hbase.apache.org/book.html]. It's maintained and looked after > with diligence. We also have an HBase section on the [hadoop > wiki|http://wiki.apache.org/hadoop/Hbase] that hasn't been updated since > 2012. Let's sift through the pages of the wiki, bring over any content that's > still relevant and not already present in the book, and kill the wiki. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14741) Update Jython example from HBASE-14638 to use new APIs
Misty Stanley-Jones created HBASE-14741: --- Summary: Update Jython example from HBASE-14638 to use new APIs Key: HBASE-14741 URL: https://issues.apache.org/jira/browse/HBASE-14741 Project: HBase Issue Type: Task Reporter: Misty Stanley-Jones Jython example was moved straight from the Wiki and needs to be updated to use post-1.0 APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14532) [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config and not described in section 7
[ https://issues.apache.org/jira/browse/HBASE-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14532: Attachment: HBASE-14532-v1.patch Reworded to address [~tedyu]'s feedback. > [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config > and not described in section 7 > - > > Key: HBASE-14532 > URL: https://issues.apache.org/jira/browse/HBASE-14532 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Rick Moritz >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-14532-v1.patch, HBASE-14532.patch > > > After trying to figure out whether shortcircuit reads would work on my > system, I studied the book and found conflicting information. > It's suggested in section 92.2, that dfs.client.read.shortcircuit is an > option in hbase-site.xml, but the supposedly complete default configuration > in section 7 does not include this setting. This leads to confusion on > whether it's sufficient to enable this setting in hdfs-site.xml, or whether > it needs to be added to both configurations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14640) Move Cascading info from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14640: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Move Cascading info from Wiki to Ref Guide > -- > > Key: HBASE-14640 > URL: https://issues.apache.org/jira/browse/HBASE-14640 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14640.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13478) Document the change of default master ports being used .
[ https://issues.apache.org/jira/browse/HBASE-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-13478: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.0.0 Status: Resolved (was: Patch Available) Pushed with present-tense wording. Thanks! > Document the change of default master ports being used . > > > Key: HBASE-13478 > URL: https://issues.apache.org/jira/browse/HBASE-13478 > Project: HBase > Issue Type: Sub-task > Components: documentation >Reporter: Srikanth Srungarapu >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-13478.patch > > > In 1.0.x, master by default binds to the region server ports. But in 1.1 and > 2.0 branches, we have undone this changes and brought back the usage of old > master ports to make the migration from 0.98 -> 1.1 hassle free. Please see > the parent jira for more background. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14638) Move Jython info from the Wiki to the Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14638: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master. > Move Jython info from the Wiki to the Ref Guide > --- > > Key: HBASE-14638 > URL: https://issues.apache.org/jira/browse/HBASE-14638 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14638.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
[ https://issues.apache.org/jira/browse/HBASE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14739: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master. > Fix broken link to Javadoc that is suppressed because it is generated code > --- > > Key: HBASE-14739 > URL: https://issues.apache.org/jira/browse/HBASE-14739 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-14739.patch > > > We no longer build Javadoc of generated code. There was a manual link to a > generated API referenced in a package-summary.html. Remove that. Also clean > up a few trailing spaces in the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14575) Reduce scope of compactions holding region lock
[ https://issues.apache.org/jira/browse/HBASE-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984739#comment-14984739 ] ramkrishna.s.vasudevan commented on HBASE-14575: Thanks Ted. My bad. I missed that. True that the patch is removing the lock as intended. I think there should be minimal or no impact of this patch on HBASE-13082 as it is more to deal with the region lock and not the storeScanner lock. > Reduce scope of compactions holding region lock > --- > > Key: HBASE-14575 > URL: https://issues.apache.org/jira/browse/HBASE-14575 > Project: HBase > Issue Type: Sub-task > Components: Compaction, regionserver >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Attachments: 14575-v1.patch, 14575-v2.patch, 14575-v3.patch, > 14575-v4.patch, 14575.v00.patch > > > Per [~devaraj]'s idea on parent issue, let's see if we can reduce the scope > of critical section under which compactions hold the region read lock. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
[
https://issues.apache.org/jira/browse/HBASE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984652#comment-14984652
]
Hadoop QA commented on HBASE-14739:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12770008/HBASE-14739.patch
against master branch at commit 4c25549e9f270ecef6c13bff8f46cef68bf5ba56.
ATTACHMENT ID: 12770008
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+0 tests included{color}. The patch appears to be a
documentation patch that doesn't require tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.6.1 2.7.0
2.7.1)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/16338//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/16338//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/16338//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/16338//console
This message is automatically generated.
> Fix broken link to Javadoc that is suppressed because it is generated code
> ---
>
> Key: HBASE-14739
> URL: https://issues.apache.org/jira/browse/HBASE-14739
> Project: HBase
> Issue Type: Bug
> Components: documentation
>Reporter: Misty Stanley-Jones
>Assignee: Misty Stanley-Jones
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-14739.patch
>
>
> We no longer build Javadoc of generated code. There was a manual link to a
> generated API referenced in a package-summary.html. Remove that. Also clean
> up a few trailing spaces in the process.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14639) Move Scala info from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14639: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master. > Move Scala info from Wiki to Ref Guide > -- > > Key: HBASE-14639 > URL: https://issues.apache.org/jira/browse/HBASE-14639 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14639.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14740) Refactor Scala example from HBASE-14639 to use new APIs
Misty Stanley-Jones created HBASE-14740: --- Summary: Refactor Scala example from HBASE-14639 to use new APIs Key: HBASE-14740 URL: https://issues.apache.org/jira/browse/HBASE-14740 Project: HBase Issue Type: Task Reporter: Misty Stanley-Jones Assignee: Ted Malaska Ted, if you don't want to try your hand at this, feel free to unassign yourself. :) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (HBASE-14481) Decommission HBase wiki
[ https://issues.apache.org/jira/browse/HBASE-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-14481 started by Misty Stanley-Jones. --- > Decommission HBase wiki > --- > > Key: HBASE-14481 > URL: https://issues.apache.org/jira/browse/HBASE-14481 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Nick Dimiduk >Assignee: Misty Stanley-Jones >Priority: Blocker > Labels: beginner > Fix For: 2.0.0 > > > We have an awesome community resource in our [online > book|http://hbase.apache.org/book.html]. It's maintained and looked after > with diligence. We also have an HBase section on the [hadoop > wiki|http://wiki.apache.org/hadoop/Hbase] that hasn't been updated since > 2012. Let's sift through the pages of the wiki, bring over any content that's > still relevant and not already present in the book, and kill the wiki. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14481) Decommission HBase wiki
[ https://issues.apache.org/jira/browse/HBASE-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984726#comment-14984726 ] Misty Stanley-Jones commented on HBASE-14481: - All the work on this is done. I need to put in a few redirect URLs into the wiki but I can't load the Wiki pages at all right now. I'll try again tomorrow. > Decommission HBase wiki > --- > > Key: HBASE-14481 > URL: https://issues.apache.org/jira/browse/HBASE-14481 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Nick Dimiduk >Assignee: Misty Stanley-Jones >Priority: Blocker > Labels: beginner > Fix For: 2.0.0 > > > We have an awesome community resource in our [online > book|http://hbase.apache.org/book.html]. It's maintained and looked after > with diligence. We also have an HBase section on the [hadoop > wiki|http://wiki.apache.org/hadoop/Hbase] that hasn't been updated since > 2012. Let's sift through the pages of the wiki, bring over any content that's > still relevant and not already present in the book, and kill the wiki. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14737) Clear cachedMaxVersions when setValue(VERSIONS, value) called
[
https://issues.apache.org/jira/browse/HBASE-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984637#comment-14984637
]
Pankaj Kumar commented on HBASE-14737:
--
Thanks [~giacomotaylor], Are you planning to provide a patch?
> Clear cachedMaxVersions when setValue(VERSIONS, value) called
> -
>
> Key: HBASE-14737
> URL: https://issues.apache.org/jira/browse/HBASE-14737
> Project: HBase
> Issue Type: Bug
>Reporter: James Taylor
>
> HColumnDescriptor caches the value of VERSIONS in a cachedMaxVersions member
> variable. This member variable should be reset or cleared when
> setValue(HConstants.VERSIONS, value) is called, like this:
> {code}
> static final bytes[] VERSIONS_BYTES = Bytes.toBytes(HConstants.VERSIONS);
> public HColumnDescriptor setValue(byte[] key, byte[] value) {
> if (Bytes.compare(HConstants.VERSIONS_BYTES, key) == 0) {
> cachedMaxVersions = UNINITIALIZED;
> }
> values.put(new ImmutableBytesWritable(key),
> new ImmutableBytesWritable(value));
> return this;
> }
> {code}
> Otherwise, you continue getting back cachedMaxVersions instead of the updated
> value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14026) Clarify "Web API" in version and compatibility docs
[ https://issues.apache.org/jira/browse/HBASE-14026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14026: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to master. > Clarify "Web API" in version and compatibility docs > --- > > Key: HBASE-14026 > URL: https://issues.apache.org/jira/browse/HBASE-14026 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Sean Busbey >Assignee: Misty Stanley-Jones >Priority: Critical > Fix For: 2.0.0 > > Attachments: HBASE-14026.patch > > > per discussion on HBASE-13861, update our version and compatibility section > to clarify under operational compatibility that by "Web page API" we mean the > /jmx endpoint. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14738) Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98
[ https://issues.apache.org/jira/browse/HBASE-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-14738: --- Description: Profiling 0.98.15 I see 20-30% of CPU time spent in Hadoop's PureJavaCrc32. Not surprising given previous results described on HBASE-11927. Backport. There are two issues with the backport: # The patch on 11927 changes the default CRC type from CRC32 to CRC32C. Although the changes are backwards compatible -files with either CRC type will be handled correctly in a transparent manner - we should probably leave the default alone in 0.98 and advise users on a site configuration change to use CRC32C if desired, for potential hardware acceleration. # Need a shim for differences between Hadoop's DataChecksum type. was: Profiling 0.98.15 I see 20-30% of CPU time spent in Hadoop's PureJavaCrc32. Not surprising given previous results described on HBASE-11927. Backport. There are two issues with the backport: # The patch on 11927 changes the default CRC type from CRC32 to CRC32C. Although the changes are backwards compatible -files with either CRC type will be handled correctly in a transparent manner - we should probably leave the default alone in 0.98 and advise users on a site configuration change to use CRC32C if desired, for potential hardware acceleration. # Need a shim for differences between Hadoop's DataChecksum type. > Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98 > --- > > Key: HBASE-14738 > URL: https://issues.apache.org/jira/browse/HBASE-14738 > Project: HBase > Issue Type: Task >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 0.98.16 > > > Profiling 0.98.15 I see 20-30% of CPU time spent in Hadoop's PureJavaCrc32. > Not surprising given previous results described on HBASE-11927. Backport. > There are two issues with the backport: > # The patch on 11927 changes the default CRC type from CRC32 to CRC32C. > Although the changes are backwards compatible -files with either CRC type > will be handled correctly in a transparent manner - we should probably leave > the default alone in 0.98 and advise users on a site configuration change to > use CRC32C if desired, for potential hardware acceleration. > # Need a shim for differences between Hadoop's DataChecksum type. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
[ https://issues.apache.org/jira/browse/HBASE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14739: Status: Patch Available (was: Open) Does what it says on the tin. > Fix broken link to Javadoc that is suppressed because it is generated code > --- > > Key: HBASE-14739 > URL: https://issues.apache.org/jira/browse/HBASE-14739 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-14739.patch > > > We no longer build Javadoc of generated code. There was a manual link to a > generated API referenced in a package-summary.html. Remove that. Also clean > up a few trailing spaces in the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14605) Split fails due to 'No valid credentials' error when SecureBulkLoadEndpoint#start tries to access hdfs
[
https://issues.apache.org/jira/browse/HBASE-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984451#comment-14984451
]
Hudson commented on HBASE-14605:
FAILURE: Integrated in HBase-0.98-matrix #254 (See
[https://builds.apache.org/job/HBase-0.98-matrix/254/])
HBASE-14605 Addendum restores two methods in SplitTransaction (tedyu: rev
90d920caa64ef67b186314157958e349022e3015)
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
> Split fails due to 'No valid credentials' error when
> SecureBulkLoadEndpoint#start tries to access hdfs
> --
>
> Key: HBASE-14605
> URL: https://issues.apache.org/jira/browse/HBASE-14605
> Project: HBase
> Issue Type: Sub-task
>Reporter: Ted Yu
>Assignee: Ted Yu
> Fix For: 2.0.0, 1.2.0, 1.3.0, 1.0.3, 1.1.3, 0.98.16
>
> Attachments: 144605-branch-1-v3.txt, 14605-0.98-v5.txt,
> 14605-branch-1-addendum.txt, 14605-branch-1-v4.txt, 14605-branch-1-v5.txt,
> 14605-branch-1.0-v5.txt, 14605-v1.txt, 14605-v2.txt, 14605-v3.txt,
> 14605-v3.txt, 14605-v3.txt, 14605-v4.txt, 14605-v5.txt, 14605.alt
>
>
> During recent testing in secure cluster (with HBASE-14475), we found the
> following when user X (non-super user) split a table with region replica:
> {code}
> 2015-10-12 10:58:18,955 ERROR [FifoRpcScheduler.handler1-thread-9]
> master.HMaster: Region server hbase-4-4.novalocal,60020,1444645588137
> reported a fatal error:
> ABORTING region server hbase-4-4.novalocal,60020,1444645588137: The
> coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint
> threw an unexpected exception
> Cause:
> java.lang.IllegalStateException: Failed to get FileSystem instance
> at
> org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint.start(SecureBulkLoadEndpoint.java:148)
> at
> org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost.java:415)
> at
> org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadInstance(CoprocessorHost.java:257)
> at
> org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:160)
> at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.(RegionCoprocessorHost.java:192)
> at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:701)
> at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:608)
> ...
> Caused by: java.io.IOException: Failed on local exception:
> java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed
> [Caused by GSSException: No valid credentials provided (Mechanism
> level: Failed to find any Kerberos tgt)]; Host Details : local host is:
> "hbase-4-4/172.22.66.186"; destination host is: "os-r6-
> okarus-hbase-4-2.novalocal":8020;
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
> at org.apache.hadoop.ipc.Client.call(Client.java:1473)
> at org.apache.hadoop.ipc.Client.call(Client.java:1400)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
> at com.sun.proxy.$Proxy18.mkdirs(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:555)
> at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
> at com.sun.proxy.$Proxy19.mkdirs(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2775)
> at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2746)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:967)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:963)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> {code}
> The cause was that SecureBulkLoadEndpoint#start tried to create staging dir
> in hdfs as user X but didn't pass authentication.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14678) Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs
[ https://issues.apache.org/jira/browse/HBASE-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984591#comment-14984591 ] stack commented on HBASE-14678: --- So, random tests show as hung, killed, with this on the end. ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? This is even after going back to 2.18.1 surefire. So, while this experiment has stabilized tests some, I've not been able to finger a particular test as the killer, the culprit. > Experiment: Temporarily disable balancer and a few others to see if root of > crashed/timedout JVMs > - > > Key: HBASE-14678 > URL: https://issues.apache.org/jira/browse/HBASE-14678 > Project: HBase > Issue Type: Sub-task > Components: test >Reporter: stack > > Looking at recent builds of 1.2, I see a few of the runs finishing with kills > and notice that a JVM exited without reporting back state. Running the > hanging test finder, I can see at least that in one case that the balancer > tests seem to be outstanding; looking in test output, seems to be still going > on A few others are reported as hung but they look like they have just > started running and are just killed by surefire. > This issue is about trying to disable a few of the problematics like balancer > tests to see if our overall stability improves. If so, I can concentrate on > stabilizing these few tests. Else will just undo the experiment and put the > tests back on line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14732) Update HBase website skin and CSS
[ https://issues.apache.org/jira/browse/HBASE-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14732: Attachment: HBASE-14732-v1.patch It applies for me locally (using git am against a fresh master), but attaching a fresh patch just to be sure. > Update HBase website skin and CSS > - > > Key: HBASE-14732 > URL: https://issues.apache.org/jira/browse/HBASE-14732 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14732-v1.patch, HBASE-14732.patch > > > Use Fluido skin, make things more readable, make improvements to enhance the > mobile experience. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14737) Clear cachedMaxVersions when setValue(VERSIONS, value) called
James Taylor created HBASE-14737:
Summary: Clear cachedMaxVersions when setValue(VERSIONS, value)
called
Key: HBASE-14737
URL: https://issues.apache.org/jira/browse/HBASE-14737
Project: HBase
Issue Type: Bug
Reporter: James Taylor
HColumnDescriptor caches the value of VERSIONS in a cachedMaxVersions member
variable. This member variable should be reset or cleared when
setValue(HConstants.VERSIONS, value) is called, like this:
{code}
static final bytes[] VERSIONS_BYTES = Bytes.toBytes(HConstants.VERSIONS);
public HColumnDescriptor setValue(byte[] key, byte[] value) {
if (Bytes.compare(HConstants.VERSIONS_BYTES, key) == 0) {
cachedMaxVersions = UNINITIALIZED;
}
values.put(new ImmutableBytesWritable(key),
new ImmutableBytesWritable(value));
return this;
}
{code}
Otherwise, you continue getting back cachedMaxVersions instead of the updated
value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-14738) Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98
Andrew Purtell created HBASE-14738: -- Summary: Backport HBASE-11927 (Use Native Hadoop Library for HFile checksum) to 0.98 Key: HBASE-14738 URL: https://issues.apache.org/jira/browse/HBASE-14738 Project: HBase Issue Type: Task Reporter: Andrew Purtell Assignee: Andrew Purtell Fix For: 0.98.16 Profiling 0.98.15 I see 20-30% of CPU time spent in Hadoop's PureJavaCrc32. Not surprising given previous results described on HBASE-11927. Backport. There are two issues with the backport: # The patch on 11927 changes the default CRC type from CRC32 to CRC32C. Although the changes are backwards compatible -files with either CRC type will be handled correctly in a transparent manner - we should probably leave the default alone in 0.98 and advise users on a site configuration change to use CRC32C if desired, for potential hardware acceleration. # Need a shim for differences between Hadoop's DataChecksum type. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
Misty Stanley-Jones created HBASE-14739: --- Summary: Fix broken link to Javadoc that is suppressed because it is generated code Key: HBASE-14739 URL: https://issues.apache.org/jira/browse/HBASE-14739 Project: HBase Issue Type: Bug Components: documentation Reporter: Misty Stanley-Jones Assignee: Misty Stanley-Jones Priority: Trivial Fix For: 2.0.0 We no longer build Javadoc of generated code. There was a manual link to a generated API referenced in a package-summary.html. Remove that. Also clean up a few trailing spaces in the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14679) Separate security shell tests from other shell tests
[ https://issues.apache.org/jira/browse/HBASE-14679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984755#comment-14984755 ] stack commented on HBASE-14679: --- bq. Investigation on TestShell is needed. And so. bq. Resolving. ? > Separate security shell tests from other shell tests > > > Key: HBASE-14679 > URL: https://issues.apache.org/jira/browse/HBASE-14679 > Project: HBase > Issue Type: Task >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 14679-branch-1-v1.txt, 14679-branch-1-v1.txt > > > TestShell takes a long time to run, sometimes timing out (especially on > branch-1). > This issue proposes the following changes: > separate security shell tests into their own test class > use unique table names for different tests -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14730) region server needs to log warnings when there are attributes configured for cells with hfile v2
[ https://issues.apache.org/jira/browse/HBASE-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984775#comment-14984775 ] Anoop Sam John commented on HBASE-14730: bq.When cells are flushed from memStore to Hfile, attributes are not saved. You mean Cell Tags? > region server needs to log warnings when there are attributes configured for > cells with hfile v2 > > > Key: HBASE-14730 > URL: https://issues.apache.org/jira/browse/HBASE-14730 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: huaxiang sun >Assignee: huaxiang sun > > User can configure cell attributes with hfile.format.version 2. When cells > are flushed from memStore to Hfile, attributes are not saved. Warnings need > to be logged. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14728) TestRowCounter is broken in master
[
https://issues.apache.org/jira/browse/HBASE-14728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack updated HBASE-14728:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks for the patch [~abhishek.chouhan]
> TestRowCounter is broken in master
> --
>
> Key: HBASE-14728
> URL: https://issues.apache.org/jira/browse/HBASE-14728
> Project: HBase
> Issue Type: Test
>Affects Versions: 2.0.0
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
> Fix For: 2.0.0
>
> Attachments: HBASE-14728.patch, HBASE-14728.patch
>
>
> The runRowCount method simply runs the RowCounter and checks if the exit code
> is zero but does not actually check the row count returned
> {noformat}
> private void runRowCount(String[] args, int expectedCount) throws Exception {
> final RowCounter counter = new RowCounter();
> assertEquals("job failed either due to failure or miscount (see log
> output).", 0,
> ToolRunner.run(TEST_UTIL.getConfiguration(), counter, args));
> }
> {noformat}
> This will always give a false positive provided the job ran without errors
> (irrespective of the count it gives).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14730) region server needs to log warnings when there are attributes configured for cells with hfile v2
[ https://issues.apache.org/jira/browse/HBASE-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984777#comment-14984777 ] Anoop Sam John commented on HBASE-14730: Adding a log for every flush will be too much of log info? > region server needs to log warnings when there are attributes configured for > cells with hfile v2 > > > Key: HBASE-14730 > URL: https://issues.apache.org/jira/browse/HBASE-14730 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: huaxiang sun >Assignee: huaxiang sun > > User can configure cell attributes with hfile.format.version 2. When cells > are flushed from memStore to Hfile, attributes are not saved. Warnings need > to be logged. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14575) Reduce scope of compactions holding region lock
[ https://issues.apache.org/jira/browse/HBASE-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984784#comment-14984784 ] Jerry He commented on HBASE-14575: -- As [~ndimiduk] mentioned, we've been doing a lot of checks for close (store.areWritesEnabled()) in performCompaction() Maybe we could a couple of more outside of performCompaction() and in between we try to hold the region read lock? bq. +readLock.lock(); // hold region open while we create scanners over storefiles. It is probably good to do this. But there seems to be no critical section to protect here and can be relaxed as well? > Reduce scope of compactions holding region lock > --- > > Key: HBASE-14575 > URL: https://issues.apache.org/jira/browse/HBASE-14575 > Project: HBase > Issue Type: Sub-task > Components: Compaction, regionserver >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Attachments: 14575-v1.patch, 14575-v2.patch, 14575-v3.patch, > 14575-v4.patch, 14575.v00.patch > > > Per [~devaraj]'s idea on parent issue, let's see if we can reduce the scope > of critical section under which compactions hold the region read lock. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14706) RegionLocationFinder should return multiple servername by top host
[
https://issues.apache.org/jira/browse/HBASE-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984802#comment-14984802
]
Hadoop QA commented on HBASE-14706:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12770028/HBASE-14706-trunk_v3.patch
against master branch at commit e8d6bf7d461fd9428ec55009ce1c24d8f3f65485.
ATTACHMENT ID: 12770028
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.6.1 2.7.0
2.7.1)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/16340//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/16340//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/16340//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/16340//console
This message is automatically generated.
> RegionLocationFinder should return multiple servername by top host
> --
>
> Key: HBASE-14706
> URL: https://issues.apache.org/jira/browse/HBASE-14706
> Project: HBase
> Issue Type: Bug
> Components: Balancer
>Affects Versions: 2.0.0, 1.2.0, 1.3.0
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-14706-trunk_v1.patch, HBASE-14706-trunk_v2.patch,
> HBASE-14706-trunk_v3.patch, HBASE-14706.patch
>
>
> Multiple RS can run on the same host. But in current RegionLocationFinder,
> mapHostNameToServerName map one host to only one server. This will make
> LocalityCostFunction get wrong locality about region.
> {code}
> // create a mapping from hostname to ServerName for fast lookup
> HashMap hostToServerName = new HashMap ServerName>();
> for (ServerName sn : regionServers) {
> hostToServerName.put(sn.getHostname(), sn);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (HBASE-14725) Vet categorization of tests so they for sure go into the right small/medium/large buckets
[ https://issues.apache.org/jira/browse/HBASE-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-14725. --- Resolution: Fixed Hadoop Flags: Reviewed Pushed to 1.2+ Thanks [~busbey] for the intercession. > Vet categorization of tests so they for sure go into the right > small/medium/large buckets > - > > Key: HBASE-14725 > URL: https://issues.apache.org/jira/browse/HBASE-14725 > Project: HBase > Issue Type: Sub-task > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0, 1.2.0, 1.3.0 > > Attachments: 14725v2 (1).txt, 14725v2 (1).txt, 14725v2.txt, > 14725v2.txt, 14725v4.txt, 14725v4.txt, categorization.patch > > > I tried doing runSmallTests, runMediumTests, etc., and I noticed that some > tests are larger than our categorization. At least for small tests it means > they area all running in the one JVM. I also noticed that the categorization > only takes effect in hbase-server. > This patch makes it so runSmallTests runs all the small tests only in each > category. Also moves tests that were larger than small out to medium so they > don't run in the one JVM anymore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14725) Vet categorization of tests so they for sure go into the right small/medium/large buckets
[ https://issues.apache.org/jira/browse/HBASE-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-14725: -- Assignee: stack Fix Version/s: 1.3.0 1.2.0 2.0.0 Status: In Progress (was: Patch Available) > Vet categorization of tests so they for sure go into the right > small/medium/large buckets > - > > Key: HBASE-14725 > URL: https://issues.apache.org/jira/browse/HBASE-14725 > Project: HBase > Issue Type: Sub-task > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0, 1.2.0, 1.3.0 > > Attachments: 14725v2 (1).txt, 14725v2 (1).txt, 14725v2.txt, > 14725v2.txt, 14725v4.txt, 14725v4.txt, categorization.patch > > > I tried doing runSmallTests, runMediumTests, etc., and I noticed that some > tests are larger than our categorization. At least for small tests it means > they area all running in the one JVM. I also noticed that the categorization > only takes effect in hbase-server. > This patch makes it so runSmallTests runs all the small tests only in each > category. Also moves tests that were larger than small out to medium so they > don't run in the one JVM anymore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14638) Move Jython info from the Wiki to the Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984835#comment-14984835 ] Hudson commented on HBASE-14638: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14638 Move Jython info from the Wiki to the Ref Guide (mstanleyjones: rev 9659f14020b13db010aac1a069b5c2aa7962c867) * src/main/asciidoc/_chapters/external_apis.adoc > Move Jython info from the Wiki to the Ref Guide > --- > > Key: HBASE-14638 > URL: https://issues.apache.org/jira/browse/HBASE-14638 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14638.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14641) Move JDO example from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984831#comment-14984831 ] Hudson commented on HBASE-14641: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14641 Move JDO example to HBase Ref Guide (mstanleyjones: rev 7ad7a7943aaf6572a291ff53c59446b967abd622) * src/main/asciidoc/_chapters/external_apis.adoc > Move JDO example from Wiki to Ref Guide > --- > > Key: HBASE-14641 > URL: https://issues.apache.org/jira/browse/HBASE-14641 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14641-v1.patch, HBASE-14641.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14026) Clarify "Web API" in version and compatibility docs
[ https://issues.apache.org/jira/browse/HBASE-14026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984838#comment-14984838 ] Hudson commented on HBASE-14026: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14026 Clarify 'Web API' in version and compatibility docs (mstanleyjones: rev c3d40b0b68ef3f8d45bfb846668c8dde49e79cb1) * src/main/asciidoc/_chapters/upgrading.adoc > Clarify "Web API" in version and compatibility docs > --- > > Key: HBASE-14026 > URL: https://issues.apache.org/jira/browse/HBASE-14026 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Sean Busbey >Assignee: Misty Stanley-Jones >Priority: Critical > Fix For: 2.0.0 > > Attachments: HBASE-14026.patch > > > per discussion on HBASE-13861, update our version and compatibility section > to clarify under operational compatibility that by "Web page API" we mean the > /jmx endpoint. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14739) Fix broken link to Javadoc that is suppressed because it is generated code
[ https://issues.apache.org/jira/browse/HBASE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984833#comment-14984833 ] Hudson commented on HBASE-14739: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14739 Fix broken link to Javadoc that is suppressed because it is (mstanleyjones: rev 9c37239f582d51cb99718f5445f64b273c2251ed) * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/package.html > Fix broken link to Javadoc that is suppressed because it is generated code > --- > > Key: HBASE-14739 > URL: https://issues.apache.org/jira/browse/HBASE-14739 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-14739.patch > > > We no longer build Javadoc of generated code. There was a manual link to a > generated API referenced in a package-summary.html. Remove that. Also clean > up a few trailing spaces in the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14532) [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config and not described in section 7
[ https://issues.apache.org/jira/browse/HBASE-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984834#comment-14984834 ] Hudson commented on HBASE-14532: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14532 Add dfs shortcircuit configs to hbase-default.xml, fix (mstanleyjones: rev e8d6bf7d461fd9428ec55009ce1c24d8f3f65485) * src/main/asciidoc/_chapters/architecture.adoc * hbase-common/src/main/resources/hbase-default.xml > [book] dfs.client.read.shortcircuit is referenced as hbase-site.xml config > and not described in section 7 > - > > Key: HBASE-14532 > URL: https://issues.apache.org/jira/browse/HBASE-14532 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Rick Moritz >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-14532-v1.patch, HBASE-14532.patch > > > After trying to figure out whether shortcircuit reads would work on my > system, I studied the book and found conflicting information. > It's suggested in section 92.2, that dfs.client.read.shortcircuit is an > option in hbase-site.xml, but the supposedly complete default configuration > in section 7 does not include this setting. This leads to confusion on > whether it's sufficient to enable this setting in hdfs-site.xml, or whether > it needs to be added to both configurations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14640) Move Cascading info from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984832#comment-14984832 ] Hudson commented on HBASE-14640: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14640 Move Cascading info from Wiki to Ref Guide (mstanleyjones: rev 185a62a403e48b88fc6a7725e17cd6815dceec23) * src/main/asciidoc/_chapters/mapreduce.adoc > Move Cascading info from Wiki to Ref Guide > -- > > Key: HBASE-14640 > URL: https://issues.apache.org/jira/browse/HBASE-14640 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14640.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14639) Move Scala info from Wiki to Ref Guide
[ https://issues.apache.org/jira/browse/HBASE-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984836#comment-14984836 ] Hudson commented on HBASE-14639: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-14639 Move Scala info from HBase Wiki to Ref Guide (mstanleyjones: rev 12a718d0ca507c911f589d2926cfc408e4155b0e) * src/main/asciidoc/_chapters/external_apis.adoc > Move Scala info from Wiki to Ref Guide > -- > > Key: HBASE-14639 > URL: https://issues.apache.org/jira/browse/HBASE-14639 > Project: HBase > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.0.0 >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-14639.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13478) Document the change of default master ports being used .
[ https://issues.apache.org/jira/browse/HBASE-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984837#comment-14984837 ] Hudson commented on HBASE-13478: FAILURE: Integrated in HBase-Trunk_matrix #420 (See [https://builds.apache.org/job/HBase-Trunk_matrix/420/]) HBASE-13478 Document the change of default master ports being used (mstanleyjones: rev 988ff62e981eab3d1f071586aedf6b98d54fa857) * src/main/asciidoc/_chapters/upgrading.adoc > Document the change of default master ports being used . > > > Key: HBASE-13478 > URL: https://issues.apache.org/jira/browse/HBASE-13478 > Project: HBase > Issue Type: Sub-task > Components: documentation >Reporter: Srikanth Srungarapu >Assignee: Misty Stanley-Jones >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-13478.patch > > > In 1.0.x, master by default binds to the region server ports. But in 1.1 and > 2.0 branches, we have undone this changes and brought back the usage of old > master ports to make the migration from 0.98 -> 1.1 hassle free. Please see > the parent jira for more background. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14725) Vet categorization of tests so they for sure go into the right small/medium/large buckets
[ https://issues.apache.org/jira/browse/HBASE-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984857#comment-14984857 ] Hudson commented on HBASE-14725: SUCCESS: Integrated in HBase-1.2-IT #257 (See [https://builds.apache.org/job/HBase-1.2-IT/257/]) HBASE-14725 Vet categorization of tests so they for sure go into the (stack: rev a1e578b5900647c6fec93eff52abc9074c0c323c) * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestColumnSeeking.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileLinkCleaner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java * hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java * pom.xml * hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestRpcClientLeaks.java * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMultiVersionConcurrencyControl.java * hbase-hadoop-compat/src/test/java/org/apache/hadoop/hbase/master/TestMetricsMasterSourceFactory.java * hbase-server/pom.xml * hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/util/TestTimeoutBlockingQueue.java * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java > Vet categorization of tests so they for sure go into the right > small/medium/large buckets > - > > Key: HBASE-14725 > URL: https://issues.apache.org/jira/browse/HBASE-14725 > Project: HBase > Issue Type: Sub-task > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0, 1.2.0, 1.3.0 > > Attachments: 14725v2 (1).txt, 14725v2 (1).txt, 14725v2.txt, > 14725v2.txt, 14725v4.txt, 14725v4.txt, categorization.patch > > > I tried doing runSmallTests, runMediumTests, etc., and I noticed that some > tests are larger than our categorization. At least for small tests it means > they area all running in the one JVM. I also noticed that the categorization > only takes effect in hbase-server. > This patch makes it so runSmallTests runs all the small tests only in each > category. Also moves tests that were larger than small out to medium so they > don't run in the one JVM anymore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14420) Zombie Stomping Session
[ https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-14420: -- Attachment: none_fix.txt > Zombie Stomping Session > --- > > Key: HBASE-14420 > URL: https://issues.apache.org/jira/browse/HBASE-14420 > Project: HBase > Issue Type: Umbrella > Components: test >Reporter: stack >Assignee: stack >Priority: Critical > Attachments: hangers.txt, none_fix (1).txt, none_fix.txt, > none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, > none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, > none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, > none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, > none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, none_fix.txt, > none_fix.txt, none_fix.txt > > > Patch build are now failing most of the time because we are dropping zombies. > I confirm we are doing this on non-apache build boxes too. > Left-over zombies consume resources on build boxes (OOME cannot create native > threads). Having to do multiple test runs in the hope that we can get a > non-zombie-making build or making (arbitrary) rulings that the zombies are > 'not related' is a productivity sink. And so on... > This is an umbrella issue for a zombie stomping session that started earlier > this week. Will hang sub-issues of this one. Am running builds back-to-back > on little cluster to turn out the monsters. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13014) Java Tool For Region Moving
[ https://issues.apache.org/jira/browse/HBASE-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-13014: -- Attachment: HBASE-13014-master-v3 (1).patch Looking good. Lets get another qa run in. Rather than wait till this 'stabilizies', I 'd suggest replacing the ruby script immediately after this goes in else it won't get exercised if it can't replace the ruby script, lets find out sooner than later. Good stuff. > Java Tool For Region Moving > > > Key: HBASE-13014 > URL: https://issues.apache.org/jira/browse/HBASE-13014 > Project: HBase > Issue Type: Improvement >Reporter: Abhishek Singh Chouhan >Assignee: Abhishek Singh Chouhan > Fix For: 2.0.0 > > Attachments: HBASE-13014-master-v2.patch, HBASE-13014-master-v3 > (1).patch, HBASE-13014-master-v3.patch, HBASE-13014-master-v3.patch, > HBASE-13014-master-v3.patch, HBASE-13014-master.patch, HBASE-13014-v2.patch, > HBASE-13014-v3.patch, HBASE-13014-v4.patch, HBASE-13014-v5.patch, > HBASE-13014-v6.patch, HBASE-13014.patch > > > As per discussion on HBASE-12989 we should move the functionality of > region_mover.rb into a Java tool and use region_mover.rb only only as a > wrapper around it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13014) Java Tool For Region Moving
[ https://issues.apache.org/jira/browse/HBASE-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984761#comment-14984761 ] Abhishek Singh Chouhan commented on HBASE-13014: QA looks good :) Wanna give this another try ? [~stack] [~apurtell] > Java Tool For Region Moving > > > Key: HBASE-13014 > URL: https://issues.apache.org/jira/browse/HBASE-13014 > Project: HBase > Issue Type: Improvement >Reporter: Abhishek Singh Chouhan >Assignee: Abhishek Singh Chouhan > Fix For: 2.0.0 > > Attachments: HBASE-13014-master-v2.patch, > HBASE-13014-master-v3.patch, HBASE-13014-master-v3.patch, > HBASE-13014-master-v3.patch, HBASE-13014-master.patch, HBASE-13014-v2.patch, > HBASE-13014-v3.patch, HBASE-13014-v4.patch, HBASE-13014-v5.patch, > HBASE-13014-v6.patch, HBASE-13014.patch > > > As per discussion on HBASE-12989 we should move the functionality of > region_mover.rb into a Java tool and use region_mover.rb only only as a > wrapper around it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14731) Add -DuseMob option to ITBLL
[ https://issues.apache.org/jira/browse/HBASE-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984774#comment-14984774 ] Anoop Sam John commented on HBASE-14731: Patch looks good nit: bq.raed/write path is forced. Spell correction needed. > Add -DuseMob option to ITBLL > > > Key: HBASE-14731 > URL: https://issues.apache.org/jira/browse/HBASE-14731 > Project: HBase > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Jonathan Hsieh >Assignee: Jonathan Hsieh > Fix For: 2.0.0 > > Attachments: hbase-14731.patch > > > Previously, I would test mob by creating a table, altering to use mob and > then running ITBLL. This simplifies it by allowing for a command line arg to > enable mob on table creation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14481) Decommission HBase wiki
[ https://issues.apache.org/jira/browse/HBASE-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14481: Attachment: HBASE-14481.patch Attached patch scrubs and redirects all links from the Javadoc, Ref Guide, scripts, and website to the Wiki. All Wiki redirects have been done, too. > Decommission HBase wiki > --- > > Key: HBASE-14481 > URL: https://issues.apache.org/jira/browse/HBASE-14481 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Nick Dimiduk >Assignee: Misty Stanley-Jones >Priority: Blocker > Labels: beginner > Fix For: 2.0.0 > > Attachments: HBASE-14481.patch > > > We have an awesome community resource in our [online > book|http://hbase.apache.org/book.html]. It's maintained and looked after > with diligence. We also have an HBase section on the [hadoop > wiki|http://wiki.apache.org/hadoop/Hbase] that hasn't been updated since > 2012. Let's sift through the pages of the wiki, bring over any content that's > still relevant and not already present in the book, and kill the wiki. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14481) Decommission HBase wiki
[ https://issues.apache.org/jira/browse/HBASE-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-14481: Status: Patch Available (was: In Progress) > Decommission HBase wiki > --- > > Key: HBASE-14481 > URL: https://issues.apache.org/jira/browse/HBASE-14481 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Nick Dimiduk >Assignee: Misty Stanley-Jones >Priority: Blocker > Labels: beginner > Fix For: 2.0.0 > > Attachments: HBASE-14481.patch > > > We have an awesome community resource in our [online > book|http://hbase.apache.org/book.html]. It's maintained and looked after > with diligence. We also have an HBase section on the [hadoop > wiki|http://wiki.apache.org/hadoop/Hbase] that hasn't been updated since > 2012. Let's sift through the pages of the wiki, bring over any content that's > still relevant and not already present in the book, and kill the wiki. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
