[jira] [Updated] (HBASE-14144) Bloomfilter path to work with Byte buffered cells
[ https://issues.apache.org/jira/browse/HBASE-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-14144: --- Status: Patch Available (was: Open) Bloomfilter path to work with Byte buffered cells - Key: HBASE-14144 URL: https://issues.apache.org/jira/browse/HBASE-14144 Project: HBase Issue Type: Sub-task Components: regionserver, Scanners Reporter: ramkrishna.s.vasudevan Assignee: ramkrishna.s.vasudevan Fix For: 2.0.0 Attachments: HBASE-14144.patch, HBASE-14144_1.patch This JIRA is to check if there will be a need to make the bloom filters to work with ByteBuffer cells. During POC this path created lot of duplicated code but considering other refactorings done in this path may lead to less duplication. This JIRA is a placeholder. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14144) Bloomfilter path to work with Byte buffered cells
[ https://issues.apache.org/jira/browse/HBASE-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-14144: --- Status: Open (was: Patch Available) Bloomfilter path to work with Byte buffered cells - Key: HBASE-14144 URL: https://issues.apache.org/jira/browse/HBASE-14144 Project: HBase Issue Type: Sub-task Components: regionserver, Scanners Reporter: ramkrishna.s.vasudevan Assignee: ramkrishna.s.vasudevan Fix For: 2.0.0 Attachments: HBASE-14144.patch This JIRA is to check if there will be a need to make the bloom filters to work with ByteBuffer cells. During POC this path created lot of duplicated code but considering other refactorings done in this path may lead to less duplication. This JIRA is a placeholder. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan updated HBASE-14155:
---
Component/s: Scanners
regionserver
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted to reproduce this in a standalone HBase unit test, but have
not been able to (but I'll attach my attempt which mimics what Phoenix is
doing).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644190#comment-14644190
]
ramkrishna.s.vasudevan commented on HBASE-14155:
[~giacomotaylor]
The reason why you could directly reproduce this with your test code was
because you did not set the DataBlockEncoding on the CF.
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted to reproduce this in a standalone HBase unit test, but have
not been able to (but I'll
[jira] [Updated] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan updated HBASE-14155:
---
Status: Patch Available (was: Open)
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted to reproduce this in a standalone HBase unit test, but have
not been able to (but I'll attach my attempt which mimics what Phoenix is
doing).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan updated HBASE-14155:
---
Attachment: HBASE-14155.patch
The patch that fixes this issue with updated test cases. The test case
'testReverseScanWithoutPadding' without the fix will return only 2 values
(which is a data loss) and the test case 'testReverseScanWithPadding' will get
the StackOverFlow exception. This issue should be present in branch-1 and above.
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted
[jira] [Updated] (HBASE-14144) Bloomfilter path to work with Byte buffered cells
[ https://issues.apache.org/jira/browse/HBASE-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-14144: --- Attachment: HBASE-14144_1.patch Updated patch where in case of Keyvalue type cells we don do a copy to create the key part of the cell. Bloomfilter path to work with Byte buffered cells - Key: HBASE-14144 URL: https://issues.apache.org/jira/browse/HBASE-14144 Project: HBase Issue Type: Sub-task Components: regionserver, Scanners Reporter: ramkrishna.s.vasudevan Assignee: ramkrishna.s.vasudevan Fix For: 2.0.0 Attachments: HBASE-14144.patch, HBASE-14144_1.patch This JIRA is to check if there will be a need to make the bloom filters to work with ByteBuffer cells. During POC this path created lot of duplicated code but considering other refactorings done in this path may lead to less duplication. This JIRA is a placeholder. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan reassigned HBASE-14155:
--
Assignee: ramkrishna.s.vasudevan
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Labels: Phoenix
Attachments: ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted to reproduce this in a standalone HBase unit test, but have
not been able to (but I'll attach my attempt which mimics what Phoenix is
doing).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645234#comment-14645234 ] Hudson commented on HBASE-14086: SUCCESS: Integrated in HBase-1.0 #997 (See [https://builds.apache.org/job/HBase-1.0/997/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 819b5aa340d027a31f28a9603e4b92b301e2880b) * src/main/site/resources/css/freebsd_docbook.css * pom.xml * src/main/asciidoc/asciidoctor.css remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645243#comment-14645243 ] Hudson commented on HBASE-14086: SUCCESS: Integrated in HBase-1.1 #592 (See [https://builds.apache.org/job/HBase-1.1/592/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 08cbc244883946098fc21a37f624a1b416635d93) * pom.xml * src/main/site/resources/css/freebsd_docbook.css * src/main/asciidoc/asciidoctor.css remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14164) Display primary region replicas distribution on table.jsp
[ https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14164: --- Attachment: 14164-v2.txt Display primary region replicas distribution on table.jsp - Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor Attachments: 14164-v1.txt, 14164-v2.txt, 14164-v2.txt, table-with-primary.png While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645321#comment-14645321 ] Andrew Purtell edited comment on HBASE-14154 at 7/29/15 1:12 AM: - Patch lgtm Will commit tomorrow unless there is an objection. I added 0.98 to fix versions because we can take this change there too. I can backport. was (Author: apurtell): Patch lgtm Will commit tomorrow unless there is an objection. I added 0.98 to fix version because we can take this change there too. I can backport. DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-14154: --- Fix Version/s: 0.98.14 Patch lgtm Will commit tomorrow unless there is an objection. I added 0.98 to fix version because we can take this change there too. I can backport. DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14082) Add replica id to JMX metrics names
[
https://issues.apache.org/jira/browse/HBASE-14082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645177#comment-14645177
]
Lei Chen commented on HBASE-14082:
--
I noticed that there is a function called isDefaultReplica(int replicaid) in
RegionReplicaUtil.java
Does default replica means primary region, and I should use this function
instead of checking replicaid 0 ?
Add replica id to JMX metrics names
---
Key: HBASE-14082
URL: https://issues.apache.org/jira/browse/HBASE-14082
Project: HBase
Issue Type: Improvement
Components: metrics
Reporter: Lei Chen
Assignee: Lei Chen
Attachments: HBASE-14082-v1.patch, HBASE-14082-v2.patch
Today, via JMX, one cannot distinguish a primary region from a replica. A
possible solution is to add replica id to JMX metrics names. The benefits may
include, for example:
# Knowing the latency of a read request on a replica region means the first
attempt to the primary region has timeout.
# Write requests on replicas are due to the replication process, while the
ones on primary are from clients.
# In case of looking for hot spots of read operations, replicas should be
excluded since TIMELINE reads are sent to all replicas.
To implement, we can change the format of metrics names found at
{code}Hadoop-HBase-RegionServer-Regions-Attributes{code}
from
{code}namespace_namespace_table_tablename_region_regionname_metric_metricname{code}
to
{code}namespace_namespace_table_tablename_region_regionname_replicaid_replicaid_metric_metricname{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14082) Add replica id to JMX metrics names
[
https://issues.apache.org/jira/browse/HBASE-14082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645189#comment-14645189
]
Ted Yu commented on HBASE-14082:
Using RegionReplicaUtil.isDefaultReplica() is better.
Add replica id to JMX metrics names
---
Key: HBASE-14082
URL: https://issues.apache.org/jira/browse/HBASE-14082
Project: HBase
Issue Type: Improvement
Components: metrics
Reporter: Lei Chen
Assignee: Lei Chen
Attachments: HBASE-14082-v1.patch, HBASE-14082-v2.patch
Today, via JMX, one cannot distinguish a primary region from a replica. A
possible solution is to add replica id to JMX metrics names. The benefits may
include, for example:
# Knowing the latency of a read request on a replica region means the first
attempt to the primary region has timeout.
# Write requests on replicas are due to the replication process, while the
ones on primary are from clients.
# In case of looking for hot spots of read operations, replicas should be
excluded since TIMELINE reads are sent to all replicas.
To implement, we can change the format of metrics names found at
{code}Hadoop-HBase-RegionServer-Regions-Attributes{code}
from
{code}namespace_namespace_table_tablename_region_regionname_metric_metricname{code}
to
{code}namespace_namespace_table_tablename_region_regionname_replicaid_replicaid_metric_metricname{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14101) Fix our logo
[ https://issues.apache.org/jira/browse/HBASE-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645312#comment-14645312 ] Andrew Purtell commented on HBASE-14101: bq. Maybe better as a different jira? Sounds good to me. Fix our logo Key: HBASE-14101 URL: https://issues.apache.org/jira/browse/HBASE-14101 Project: HBase Issue Type: Bug Reporter: stack Attachments: orca-vector-image(1).zip Our Sean found that our logo is a derivative work based on what is itself a derivation only the route to the original is a bit dodgy license-wise (this latter was his finding). See his note here: http://osdir.com/ml/general/2015-07/msg20779.html We wrote the owners of the original at vectorportal.com. They have been most accommodating and changed the license to be CC-BY 3.0. If you download from here, http://www.vectorportal.com/iFile/9136/KILLER-WHALE-FREE-VECTOR.eps/inc_downloading.asp, you will see the bundled license. Let me attach the zip file here. This issue is about rebasing our image so it is derivative of the original rather than of the derivative, http://www.vectorfree.com/jumping-orca , updating NOTICES.txt, and adding a thank you to the vectorportal.com to our thanks page. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14122) Client API for determining if server side supports cell level security
[
https://issues.apache.org/jira/browse/HBASE-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645324#comment-14645324
]
Andrew Purtell commented on HBASE-14122:
bq. org.apache.hadoop.hbase.security.access.TestWithDisabledAuthorization
This could be legit. Let me look at it tomorrow.
Client API for determining if server side supports cell level security
--
Key: HBASE-14122
URL: https://issues.apache.org/jira/browse/HBASE-14122
Project: HBase
Issue Type: Improvement
Reporter: Andrew Purtell
Assignee: Andrew Purtell
Priority: Minor
Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0
Attachments: HBASE-14122-v2-0.98.patch,
HBASE-14122-v2-branch-1.patch, HBASE-14122-v2.patch, HBASE-14122.patch
Add a client API for determining if the server side supports cell level
security.
Ask the master, assuming as we do in many other instances that the master and
regionservers all have a consistent view of site configuration.
Return {{true}} if all features required for cell level security are present,
{{false}} otherwise, or throw {{UnsupportedOperationException}} if the master
does not have support for the RPC call.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14164) Display primary region replicas distribution on table.jsp
[ https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14164: --- Status: Patch Available (was: Open) Display primary region replicas distribution on table.jsp - Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor Attachments: 14164-v1.txt While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[ https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14087: Summary: ensure correct ASF policy compliant headers on source/docs (was: ensure correct ASL headers on source/docs) ensure correct ASF policy compliant headers on source/docs -- Key: HBASE-14087 URL: https://issues.apache.org/jira/browse/HBASE-14087 Project: HBase Issue Type: Sub-task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch * we have a couple of files that are missing their headers. * we have one file using old-style ASF copyrights -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[ https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645160#comment-14645160 ] Sean Busbey commented on HBASE-14087: - Jimmy's on vacation and expected back at the end of the week. Preference between waiting for his return and pushing now w/fixup later if needed? ensure correct ASF policy compliant headers on source/docs -- Key: HBASE-14087 URL: https://issues.apache.org/jira/browse/HBASE-14087 Project: HBase Issue Type: Sub-task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch * we have a couple of files that are missing their headers. * we have one file using old-style ASF copyrights -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14097) Log link to client scan troubleshooting section when scanner exceptions happen.
[ https://issues.apache.org/jira/browse/HBASE-14097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645236#comment-14645236 ] Hudson commented on HBASE-14097: FAILURE: Integrated in HBase-TRUNK #6684 (See [https://builds.apache.org/job/HBase-TRUNK/6684/]) HBASE-14097 Log link to client scan troubleshooting section when scanner exceptions happen. (ssrungarapu: rev 05de2ec5801fbba4577fb363f858a6e6f282c104) * hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java Log link to client scan troubleshooting section when scanner exceptions happen. --- Key: HBASE-14097 URL: https://issues.apache.org/jira/browse/HBASE-14097 Project: HBase Issue Type: Improvement Reporter: Srikanth Srungarapu Assignee: Srikanth Srungarapu Priority: Trivial Fix For: 2.0.0, 1.3.0 Attachments: HBASE-14097.patch As per description. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645237#comment-14645237 ] Hudson commented on HBASE-14086: FAILURE: Integrated in HBase-TRUNK #6684 (See [https://builds.apache.org/job/HBase-TRUNK/6684/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 746737714a65a7872bcb3dce323b6bd2fccafad4) * src/main/asciidoc/asciidoctor.css * src/main/site/resources/css/freebsd_docbook.css * pom.xml remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645378#comment-14645378 ] Hudson commented on HBASE-14086: SUCCESS: Integrated in HBase-0.98 #1063 (See [https://builds.apache.org/job/HBase-0.98/1063/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 89dee23bfcf1df6810121ab43c6499f940b1f82a) * src/main/site/resources/css/freebsd_docbook.css * pom.xml * src/main/asciidoc/asciidoctor.css remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645377#comment-14645377 ] Sean Busbey commented on HBASE-14158: - If you mean HBase 2.0, the plan is to backport the feature to HBase 1.y after the issues linked from HBASE-14160 are handled. Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13991) Hierarchical Layout for Humongous Tables
[ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Lau updated HBASE-13991: Description: Add support for humongous tables via a hierarchical layout for regions on filesystem. Credit for most of this code goes to Huaiyu Zhu. Latest version of the patch is available on the review board: https://reviews.apache.org/r/36029/ Known limitation of this patch: It does not deal with HFileLinks, which means that humongous tables, as implemented in this patch, would not support snapshots or timeline consistent region replicas feature in their current form. This could be addressed later but we had decided not to implement HFileLink support for the first version. was: Add support for humongous tables via a hierarchical layout for regions on filesystem. Credit for most of this code goes to Huaiyu Zhu. Latest version of the patch is available on the review board: https://reviews.apache.org/r/36029/ Hierarchical Layout for Humongous Tables Key: HBASE-13991 URL: https://issues.apache.org/jira/browse/HBASE-13991 Project: HBase Issue Type: Sub-task Reporter: Ben Lau Assignee: Ben Lau Attachments: HBASE-13991-master.patch, HumongousTableDoc.pdf Add support for humongous tables via a hierarchical layout for regions on filesystem. Credit for most of this code goes to Huaiyu Zhu. Latest version of the patch is available on the review board: https://reviews.apache.org/r/36029/ Known limitation of this patch: It does not deal with HFileLinks, which means that humongous tables, as implemented in this patch, would not support snapshots or timeline consistent region replicas feature in their current form. This could be addressed later but we had decided not to implement HFileLink support for the first version. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[ https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14087: Status: Open (was: Patch Available) post-site? wow. running locally now. ensure correct ASF policy compliant headers on source/docs -- Key: HBASE-14087 URL: https://issues.apache.org/jira/browse/HBASE-14087 Project: HBase Issue Type: Sub-task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch * we have a couple of files that are missing their headers. * we have one file using old-style ASF copyrights -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14082) Add replica id to JMX metrics names
[
https://issues.apache.org/jira/browse/HBASE-14082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645280#comment-14645280
]
Elliott Clark commented on HBASE-14082:
---
I'm really against adding anything more to that metric name. It's already too
ugly.
If anything we should be removing and moving into a different bean. So
something like:
{code}
name_to_replica_id {
aaabbb: 0,
bbbccc: 2,
},
name_to_namspace {
aaabbb: default,
bbbccc: default,
},
name_to_table {
aaabbb: foo,
bbbccc: bar,
},
RegionMetrics: {
aaabbb_mutateCount: 100,
bbbccc_mutateCount: 100,
}
{code}
However that would be a breaking change, better in a 2.0. Until then we can do:
{code}
name_to_replica_id {
aaabbb: 0,
bbbccc: 2,
},
RegionMetrics: {
namespace_default_table_foo_region_aaabbb_metric_mutateCount: 100,
namespace_default_table_foo_region_bbbccc_metric_mutateCount: 100,
}
{code}
Add replica id to JMX metrics names
---
Key: HBASE-14082
URL: https://issues.apache.org/jira/browse/HBASE-14082
Project: HBase
Issue Type: Improvement
Components: metrics
Reporter: Lei Chen
Assignee: Lei Chen
Attachments: HBASE-14082-v1.patch, HBASE-14082-v2.patch
Today, via JMX, one cannot distinguish a primary region from a replica. A
possible solution is to add replica id to JMX metrics names. The benefits may
include, for example:
# Knowing the latency of a read request on a replica region means the first
attempt to the primary region has timeout.
# Write requests on replicas are due to the replication process, while the
ones on primary are from clients.
# In case of looking for hot spots of read operations, replicas should be
excluded since TIMELINE reads are sent to all replicas.
To implement, we can change the format of metrics names found at
{code}Hadoop-HBase-RegionServer-Regions-Attributes{code}
from
{code}namespace_namespace_table_tablename_region_regionname_metric_metricname{code}
to
{code}namespace_namespace_table_tablename_region_regionname_replicaid_replicaid_metric_metricname{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645350#comment-14645350 ] Cosmin Lehene commented on HBASE-14158: --- Hey [~ted.m], does / will this require 2.0 or should it be also available on 1.x? Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14164) Display primary region replicas distribution on table.jsp
[
https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645365#comment-14645365
]
Hadoop QA commented on HBASE-14164:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747679/14164-v2.txt
against master branch at commit 05de2ec5801fbba4577fb363f858a6e6f282c104.
ATTACHMENT ID: 12747679
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:red}-1 site{color}. The patch appears to cause mvn post-site goal
to fail.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.util.TestProcessBasedCluster
org.apache.hadoop.hbase.mapreduce.TestImportExport
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14918//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14918//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14918//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14918//console
This message is automatically generated.
Display primary region replicas distribution on table.jsp
-
Key: HBASE-14164
URL: https://issues.apache.org/jira/browse/HBASE-14164
Project: HBase
Issue Type: Improvement
Reporter: Ted Yu
Assignee: Ted Yu
Priority: Minor
Attachments: 14164-v1.txt, 14164-v2.txt, 14164-v2.txt,
table-with-primary.png
While working on HBASE-14110, I enhanced table.jsp with display of primary
region replicas across region servers.
This gives user clear idea on the distribution of primary replicas.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[
https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645203#comment-14645203
]
Hadoop QA commented on HBASE-14087:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747652/HBASE-14087.2.patch
against master branch at commit 746737714a65a7872bcb3dce323b6bd2fccafad4.
ATTACHMENT ID: 12747652
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 35 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:red}-1 site{color}. The patch appears to cause mvn post-site goal
to fail.
{color:red}-1 core tests{color}. The patch failed these unit tests:
{color:red}-1 core zombie tests{color}. There are 2 zombie test(s):
at
org.apache.hadoop.hbase.TestChoreService.testForceTrigger(TestChoreService.java:379)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14915//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14915//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14915//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14915//console
This message is automatically generated.
ensure correct ASF policy compliant headers on source/docs
--
Key: HBASE-14087
URL: https://issues.apache.org/jira/browse/HBASE-14087
Project: HBase
Issue Type: Sub-task
Components: build
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch
* we have a couple of files that are missing their headers.
* we have one file using old-style ASF copyrights
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645317#comment-14645317
]
Andrew Purtell edited comment on HBASE-14085 at 7/29/15 1:07 AM:
-
bq. it would help a ton if you could handle the backporting of HBASE-14087 once
it goes in. or more immediately, backporting HBASE-14086 to 0.98 and 0.94
Yes I can certainly do that. Can do branch-1.0 as well since I'll be
temporarily standing in for Enis.
was (Author: apurtell):
bq. it would help a ton if you could handle the backporting of HBASE-14087 once
it goes in.
Yes I can certainly do that. Can do branch-1.0 as well since I'll be
temporarily standing in for Enis.
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14157) Interfaces implemented by subclasses should be checked when registering CoprocessorService
[
https://issues.apache.org/jira/browse/HBASE-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645124#comment-14645124
]
Hudson commented on HBASE-14157:
FAILURE: Integrated in HBase-TRUNK #6683 (See
[https://builds.apache.org/job/HBase-TRUNK/6683/])
HBASE-14157 Interfaces implemented by subclasses should be checked when
registering CoprocessorService (tedyu: rev
34f9a84445aba7808fa29b9357da3dc0c5042679)
*
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController2.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionCoprocessorHost.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerCoprocessorHost.java
Interfaces implemented by subclasses should be checked when registering
CoprocessorService
--
Key: HBASE-14157
URL: https://issues.apache.org/jira/browse/HBASE-14157
Project: HBase
Issue Type: Bug
Reporter: Alok Lal
Assignee: Ted Yu
Fix For: 2.0.0, 1.2.0, 1.1.2, 1.3.0
Attachments: 14157-v1.txt, 14157-v2.txt, 14157-v2.txt, 14157-v3.txt,
14157-v4.txt
Alok reported seeing the following exception when subclass of class which
implements CoprocessorService is used for hbase.coprocessor.region.classes :
{code}
hbase(main):015:0 grant 'mktg1', 'RWC', 'iemployee'
ERROR: org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No
registered coprocessor service found for name AccessControlService in region
hbase:acl,,1437137157604.2daf735ea38da95e9ba249db6b63b79c.
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7367)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1873)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1855)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
{code}
The root cause is in the following code of RegionCoprocessorHost:
{code}
for (Class? c : implClass.getInterfaces()) {
if (CoprocessorService.class.isAssignableFrom(c)) {
region.registerService( ((CoprocessorService)instance).getService() );
}
}
{code}
We currently only check the interfaces directly implemented by the underlying
class.
What should be done is to check all the interfaces implemented by class
itself and its superclasses.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14024) ImportTsv is not loading hbase-default.xml
[
https://issues.apache.org/jira/browse/HBASE-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645126#comment-14645126
]
Hudson commented on HBASE-14024:
FAILURE: Integrated in HBase-TRUNK #6683 (See
[https://builds.apache.org/job/HBase-TRUNK/6683/])
HBASE-14024 ImportTsv is not loading hbase-default.xml (Ashish Singhi)
(jerryjch: rev d2fbaf267e9388ea7ad51f0b9548dab75c9e6945)
* hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ImportTsv.java
*
hbase-examples/src/main/java/org/apache/hadoop/hbase/mapreduce/IndexBuilder.java
ImportTsv is not loading hbase-default.xml
--
Key: HBASE-14024
URL: https://issues.apache.org/jira/browse/HBASE-14024
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 2.0.0
Reporter: Ashish Singhi
Assignee: Ashish Singhi
Priority: Critical
Fix For: 2.0.0
Attachments: HBASE-14024(1).patch, HBASE-14024(2) .patch,
HBASE-14024.patch
ImportTsv job is failing with below exception
{noformat}
Exception in thread main java.lang.IllegalArgumentException: Can not create
a Path from a null string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:123)
at org.apache.hadoop.fs.Path.init(Path.java:135)
at org.apache.hadoop.fs.Path.init(Path.java:89)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configurePartitioner(HFileOutputFormat2.java:591)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:441)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:406)
at
org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:555)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:763)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:772)
{noformat}
{{hbase.fs.tmp.dir}} is set to a default value in hbase-default.xml.
I found that hbase configuration resources from its xml are not loaded into
conf object.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13992) Integrate SparkOnHBase into HBase
[ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645127#comment-14645127 ] Hudson commented on HBASE-13992: FAILURE: Integrated in HBase-TRUNK #6683 (See [https://builds.apache.org/job/HBase-TRUNK/6683/]) HBASE-13992 Integrate SparkOnHBase into HBase (busbey: rev 30f7d127c3974cff9e3058e13d7c50805ee4482f) * hbase-spark/src/test/scala/org/apache/hadoop/hbase/spark/HBaseContextSuite.scala * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseDistributedScanExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseContext.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/rdd/HBaseMapPartitionExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseStreamingBulkPutExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseBulkPutExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/JavaHBaseContext.scala * dev-support/test-patch.properties * hbase-spark/src/test/scala/org/apache/hadoop/hbase/spark/HBaseRDDFunctionsSuite.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseBulkGetExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseRDDFunctions.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseBulkDeleteExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/rdd/HBaseBulkGetExample.scala * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseDStreamFunctions.scala * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/rdd/HBaseForeachPartitionExample.scala * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseBulkPutTimestampExample.scala * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/rdd/HBaseBulkPutExample.scala * hbase-spark/src/test/java/org/apache/hadoop/hbase/spark/JavaHBaseContextSuite.java * hbase-spark/src/test/scala/org/apache/hadoop/hbase/spark/HBaseDStreamFunctionsSuite.scala * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/hbasecontext/HBaseBulkPutExampleFromFile.scala * hbase-spark/pom.xml * pom.xml * hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.java * hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/example/rdd/HBaseBulkDeleteExample.scala Integrate SparkOnHBase into HBase - Key: HBASE-13992 URL: https://issues.apache.org/jira/browse/HBASE-13992 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Attachments: HBASE-13992.10.patch, HBASE-13992.11.patch, HBASE-13992.12.patch, HBASE-13992.5.patch, HBASE-13992.6.patch, HBASE-13992.7.patch, HBASE-13992.8.patch, HBASE-13992.9.patch, HBASE-13992.patch, HBASE-13992.patch.3, HBASE-13992.patch.4, HBASE-13992.patch.5 This Jira is to ask if SparkOnHBase can find a home in side HBase core. Here is the github: https://github.com/cloudera-labs/SparkOnHBase I am the core author of this project and the license is Apache 2.0 A blog explaining this project is here http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/ A spark Streaming example is here http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/ A real customer using this in produce is blogged here http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/ Please debate and let me know what I can do to make this happen. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14057) HBase shell user_permission should list super users defined on hbase-site.xml
[
https://issues.apache.org/jira/browse/HBASE-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645125#comment-14645125
]
Hudson commented on HBASE-14057:
FAILURE: Integrated in HBase-TRUNK #6683 (See
[https://builds.apache.org/job/HBase-TRUNK/6683/])
HBASE-14057 HBase shell user_permission should list super users defined on
hbase-site.xml (ssrungarapu: rev 1d4c2452e7ed4bb25591d163c3332c34ad9eeb15)
*
hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/security/Superusers.java
*
hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlClient.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
HBase shell user_permission should list super users defined on hbase-site.xml
-
Key: HBASE-14057
URL: https://issues.apache.org/jira/browse/HBASE-14057
Project: HBase
Issue Type: Task
Components: shell
Affects Versions: 1.0.1
Reporter: Wellington Chevreuil
Assignee: Srikanth Srungarapu
Priority: Minor
Fix For: 2.0.0, 1.3.0
Attachments: HBASE-14057-branch-1.patch, HBASE-14057.patch
On HBase Shell, user_permission command without specifying any user lists all
users granted global permissions (grant 'user', 'RWXCA'):
{noformat}
hbase(main):008:0* user_permission
User
Namespace,Table,Family,Qualifier:Permission
@hbase-admin hbase,hbase:acl,,:
[Permission: actions=READ,WRITE,EXEC,CREATE,ADMIN]
1 row(s) in 3.1710 seconds
{noformat}
Users defined as super users on hbase-site.xml configuration file are not
listed by this same command, even though a super user has the same
permissions/privileges as those defined through grant 'user', 'RWXCA'
command on the shell:
{noformat}
property
namehbase.superuser/name
valuehbase-user/value
/property
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14162) regenerating thrift classes fails against 0.9.2
[
https://issues.apache.org/jira/browse/HBASE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645142#comment-14645142
]
Hadoop QA commented on HBASE-14162:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747608/HBASE-14162-branch-1.patch
against branch-1 branch at commit d2fbaf267e9388ea7ad51f0b9548dab75c9e6945.
ATTACHMENT ID: 12747608
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 lineLengths{color}. The patch introduces the following lines
longer than 100:
+lastComparison =
Boolean.valueOf(isSetBloomFilterType()).compareTo(other.isSetBloomFilterType());
+lastComparison =
Boolean.valueOf(isSetBloomFilterVectorSize()).compareTo(other.isSetBloomFilterVectorSize());
+lastComparison =
Boolean.valueOf(isSetBloomFilterNbHashes()).compareTo(other.isSetBloomFilterNbHashes());
+lastComparison =
Boolean.valueOf(isSetBlockCacheEnabled()).compareTo(other.isSetBlockCacheEnabled());
+ iface.mutateRowTs(args.tableName, args.row, args.mutations,
args.timestamp, args.attributes);
+ result.success = iface.scannerOpen(args.tableName, args.startRow,
args.columns, args.attributes);
+ result.success = iface.scannerOpenWithStop(args.tableName,
args.startRow, args.stopRow, args.columns, args.attributes);
+ result.success = iface.scannerOpenWithPrefix(args.tableName,
args.startAndPrefix, args.columns, args.attributes);
+ result.success = iface.scannerOpenTs(args.tableName, args.startRow,
args.columns, args.timestamp, args.attributes);
+ result.success = iface.scannerOpenWithStopTs(args.tableName,
args.startRow, args.stopRow, args.columns, args.timestamp, args.attributes);
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14912//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14912//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14912//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14912//console
This message is automatically generated.
regenerating thrift classes fails against 0.9.2
---
Key: HBASE-14162
URL: https://issues.apache.org/jira/browse/HBASE-14162
Project: HBase
Issue Type: Bug
Components: build, Thrift
Affects Versions: 2.0.0, 1.3.0
Reporter: Sean Busbey
Assignee: Srikanth Srungarapu
Priority: Blocker
Fix For: 2.0.0, 1.3.0
Attachments: HBASE-14162-branch-1.patch, HBASE-14162.patch
HBASE-14045 updated the thrift version, but our enforcer rule is still
checking 0.9.0.
{code}
$ git checkout master
Switched to branch 'master'
Your branch is up-to-date with 'origin/master'.
$ mvn compile -Pcompile-thrift -DskipTests
[INFO] Scanning for projects...
... SNIP ...
[INFO]
[INFO] Building HBase - Thrift 2.0.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ hbase-thrift ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-thrift-version) @
[jira] [Updated] (HBASE-14164) Display primary region replicas distribution on table.jsp
[ https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14164: --- Attachment: table-with-primary.png Screenshot showing primary region replica distribution Display primary region replicas distribution on table.jsp - Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor Attachments: 14164-v1.txt, table-with-primary.png While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14082) Add replica id to JMX metrics names
[
https://issues.apache.org/jira/browse/HBASE-14082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei Chen updated HBASE-14082:
-
Attachment: HBASE-14082-v2.patch
Updates:
1. When replica id 0, use the following format
{code}namespace_namespace_table_tablename_region_regionname_replicaid_replicaid_metric_metricname{code}
2. Test case updated.
Add replica id to JMX metrics names
---
Key: HBASE-14082
URL: https://issues.apache.org/jira/browse/HBASE-14082
Project: HBase
Issue Type: Improvement
Components: metrics
Reporter: Lei Chen
Assignee: Lei Chen
Attachments: HBASE-14082-v1.patch, HBASE-14082-v2.patch
Today, via JMX, one cannot distinguish a primary region from a replica. A
possible solution is to add replica id to JMX metrics names. The benefits may
include, for example:
# Knowing the latency of a read request on a replica region means the first
attempt to the primary region has timeout.
# Write requests on replicas are due to the replication process, while the
ones on primary are from clients.
# In case of looking for hot spots of read operations, replicas should be
excluded since TIMELINE reads are sent to all replicas.
To implement, we can change the format of metrics names found at
{code}Hadoop-HBase-RegionServer-Regions-Attributes{code}
from
{code}namespace_namespace_table_tablename_region_regionname_metric_metricname{code}
to
{code}namespace_namespace_table_tablename_region_regionname_replicaid_replicaid_metric_metricname{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14164) Display primary region replicas distribution on table.jsp
[
https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645262#comment-14645262
]
Hadoop QA commented on HBASE-14164:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747679/14164-v2.txt
against master branch at commit 05de2ec5801fbba4577fb363f858a6e6f282c104.
ATTACHMENT ID: 12747679
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14917//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14917//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14917//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14917//console
This message is automatically generated.
Display primary region replicas distribution on table.jsp
-
Key: HBASE-14164
URL: https://issues.apache.org/jira/browse/HBASE-14164
Project: HBase
Issue Type: Improvement
Reporter: Ted Yu
Assignee: Ted Yu
Priority: Minor
Attachments: 14164-v1.txt, 14164-v2.txt, table-with-primary.png
While working on HBASE-14110, I enhanced table.jsp with display of primary
region replicas across region servers.
This gives user clear idea on the distribution of primary replicas.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645317#comment-14645317
]
Andrew Purtell commented on HBASE-14085:
bq. it would help a ton if you could handle the backporting of HBASE-14087 once
it goes in.
Yes I can certainly do that. Can do branch-1.0 as well since I'll be
temporarily standing in for Enis.
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14061) Support CF-level Storage Policy
[
https://issues.apache.org/jira/browse/HBASE-14061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645371#comment-14645371
]
Andrew Purtell commented on HBASE-14061:
bq. 'hbase.hstore.block.storage.policy'
Consider making this a first class CF schema attribute. 'STORAGE_POLICY'
perhaps?
bq. fs.getStoragePolicy cannot be easily written in reflection
Agreed, this is going to be a bit messy but I had a look at the code in the
patch and it seems doable at first glance.
We could only commit this to a branch where we're willing to set the minimum
supported Hadoop version at 2.6.0 or if the storage policy API is called
through reflection we can port the result to more places.
Support CF-level Storage Policy
---
Key: HBASE-14061
URL: https://issues.apache.org/jira/browse/HBASE-14061
Project: HBase
Issue Type: Sub-task
Components: HFile, regionserver
Environment: hadoop-2.6.0
Reporter: Victor Xu
Assignee: Victor Xu
Attachments: HBASE-14061-master-v1.patch
After reading [HBASE-12848|https://issues.apache.org/jira/browse/HBASE-12848]
and [HBASE-12934|https://issues.apache.org/jira/browse/HBASE-12934], I wrote
a patch to implement cf-level storage policy.
My main purpose is to improve random-read performance for some really hot
data, which usually locates in certain column family of a big table.
Usage:
$ hbase shell
alter 'TABLE_NAME', METADATA = {'hbase.hstore.block.storage.policy' =
'POLICY_NAME'}
alter 'TABLE_NAME', {NAME='CF_NAME', METADATA =
{'hbase.hstore.block.storage.policy' = 'POLICY_NAME'}}
HDFS's setStoragePolicy can only take effect when new hfile is created in a
configured directory, so I had to make sub directories(for each cf) in
region's .tmp directory and set storage policy for them.
Besides, I had to upgrade hadoop version to 2.6.0 because
dfs.getStoragePolicy cannot be easily written in reflection, and I needed
this api to finish my unit test.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14097) Log link to client scan troubleshooting section when scanner exceptions happen.
[ https://issues.apache.org/jira/browse/HBASE-14097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Srungarapu updated HBASE-14097: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.3.0 2.0.0 Status: Resolved (was: Patch Available) Pushed to 1.3+ branches. Thanks for spending your valuable time in reviewing this minor issue, Matteo! Log link to client scan troubleshooting section when scanner exceptions happen. --- Key: HBASE-14097 URL: https://issues.apache.org/jira/browse/HBASE-14097 Project: HBase Issue Type: Improvement Reporter: Srikanth Srungarapu Assignee: Srikanth Srungarapu Priority: Trivial Fix For: 2.0.0, 1.3.0 Attachments: HBASE-14097.patch As per description. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14164) Display primary region replicas distribution on table.jsp
Ted Yu created HBASE-14164: -- Summary: Display primary region replicas distribution on table.jsp Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14164) Display primary region replicas distribution on table.jsp
[ https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14164: --- Attachment: 14164-v1.txt Display primary region replicas distribution on table.jsp - Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor Attachments: 14164-v1.txt While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14164) Display primary region replicas distribution on table.jsp
[ https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14164: --- Attachment: 14164-v2.txt Display primary region replicas distribution on table.jsp - Key: HBASE-14164 URL: https://issues.apache.org/jira/browse/HBASE-14164 Project: HBase Issue Type: Improvement Reporter: Ted Yu Assignee: Ted Yu Priority: Minor Attachments: 14164-v1.txt, 14164-v2.txt, table-with-primary.png While working on HBASE-14110, I enhanced table.jsp with display of primary region replicas across region servers. This gives user clear idea on the distribution of primary replicas. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645200#comment-14645200 ] Hudson commented on HBASE-14086: FAILURE: Integrated in HBase-1.2 #84 (See [https://builds.apache.org/job/HBase-1.2/84/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 78842f94963c3cd8a047895e523edcd08ad4af22) * src/main/site/resources/css/freebsd_docbook.css * src/main/asciidoc/asciidoctor.css * pom.xml remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14057) HBase shell user_permission should list super users defined on hbase-site.xml
[
https://issues.apache.org/jira/browse/HBASE-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645197#comment-14645197
]
Hudson commented on HBASE-14057:
SUCCESS: Integrated in HBase-1.3 #76 (See
[https://builds.apache.org/job/HBase-1.3/76/])
HBASE-14057 HBase shell user_permission should list super users defined on
hbase-site.xml (ssrungarapu: rev da811332cfb94e5106f28cb938e0c405277f191b)
*
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
*
hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlClient.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/security/Superusers.java
HBase shell user_permission should list super users defined on hbase-site.xml
-
Key: HBASE-14057
URL: https://issues.apache.org/jira/browse/HBASE-14057
Project: HBase
Issue Type: Task
Components: shell
Affects Versions: 1.0.1
Reporter: Wellington Chevreuil
Assignee: Srikanth Srungarapu
Priority: Minor
Fix For: 2.0.0, 1.3.0
Attachments: HBASE-14057-branch-1.patch, HBASE-14057.patch
On HBase Shell, user_permission command without specifying any user lists all
users granted global permissions (grant 'user', 'RWXCA'):
{noformat}
hbase(main):008:0* user_permission
User
Namespace,Table,Family,Qualifier:Permission
@hbase-admin hbase,hbase:acl,,:
[Permission: actions=READ,WRITE,EXEC,CREATE,ADMIN]
1 row(s) in 3.1710 seconds
{noformat}
Users defined as super users on hbase-site.xml configuration file are not
listed by this same command, even though a super user has the same
permissions/privileges as those defined through grant 'user', 'RWXCA'
command on the shell:
{noformat}
property
namehbase.superuser/name
valuehbase-user/value
/property
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645198#comment-14645198 ] Hudson commented on HBASE-14086: SUCCESS: Integrated in HBase-1.3 #76 (See [https://builds.apache.org/job/HBase-1.3/76/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 6e66c8d03f30f2b0821b7019faecc1c395bf8754) * src/main/site/resources/css/freebsd_docbook.css * pom.xml * src/main/asciidoc/asciidoctor.css remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[ https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14087: Status: Patch Available (was: Open) ensure correct ASF policy compliant headers on source/docs -- Key: HBASE-14087 URL: https://issues.apache.org/jira/browse/HBASE-14087 Project: HBase Issue Type: Sub-task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch, HBASE-14087.2.patch * we have a couple of files that are missing their headers. * we have one file using old-style ASF copyrights -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14087) ensure correct ASF policy compliant headers on source/docs
[ https://issues.apache.org/jira/browse/HBASE-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14087: Attachment: HBASE-14087.2.patch post-site works fine locally. the error on jenkins is about finding the checkstyle file, so I'm guessing it's a repo disappears error. :/ yetus can't get here soon enough. ensure correct ASF policy compliant headers on source/docs -- Key: HBASE-14087 URL: https://issues.apache.org/jira/browse/HBASE-14087 Project: HBase Issue Type: Sub-task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Attachments: HBASE-14087.1.patch, HBASE-14087.2.patch, HBASE-14087.2.patch * we have a couple of files that are missing their headers. * we have one file using old-style ASF copyrights -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644190#comment-14644190
]
ramkrishna.s.vasudevan edited comment on HBASE-14155 at 7/28/15 10:49 AM:
--
[~giacomotaylor]
The reason why you could NOT directly reproduce this with your test code was
because you did not set the DataBlockEncoding on the CF.
was (Author: ram_krish):
[~giacomotaylor]
The reason why you could directly reproduce this with your test code was
because you did not set the DataBlockEncoding on the CF.
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
[jira] [Commented] (HBASE-14144) Bloomfilter path to work with Byte buffered cells
[
https://issues.apache.org/jira/browse/HBASE-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644348#comment-14644348
]
Hadoop QA commented on HBASE-14144:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747540/HBASE-14144_1.patch
against master branch at commit 89d04094626abebf279e9f64d597a7085bfc8fcf.
ATTACHMENT ID: 12747540
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14910//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14910//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14910//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14910//console
This message is automatically generated.
Bloomfilter path to work with Byte buffered cells
-
Key: HBASE-14144
URL: https://issues.apache.org/jira/browse/HBASE-14144
Project: HBase
Issue Type: Sub-task
Components: regionserver, Scanners
Reporter: ramkrishna.s.vasudevan
Assignee: ramkrishna.s.vasudevan
Fix For: 2.0.0
Attachments: HBASE-14144.patch, HBASE-14144_1.patch
This JIRA is to check if there will be a need to make the bloom filters to
work with ByteBuffer cells. During POC this path created lot of duplicated
code but considering other refactorings done in this path may lead to less
duplication. This JIRA is a placeholder.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan updated HBASE-14155:
---
Priority: Critical (was: Major)
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
{code}
I've attempted to reproduce this in a standalone HBase unit test, but have
not been able to (but I'll attach my attempt which mimics what Phoenix is
doing).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14057) HBase shell user_permission should list super users defined on hbase-site.xml
[
https://issues.apache.org/jira/browse/HBASE-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srikanth Srungarapu updated HBASE-14057:
Status: Patch Available (was: In Progress)
HBase shell user_permission should list super users defined on hbase-site.xml
-
Key: HBASE-14057
URL: https://issues.apache.org/jira/browse/HBASE-14057
Project: HBase
Issue Type: Task
Components: shell
Affects Versions: 1.0.1
Reporter: Wellington Chevreuil
Assignee: Srikanth Srungarapu
Priority: Minor
Attachments: HBASE-14057-branch-1.patch, HBASE-14057.patch
On HBase Shell, user_permission command without specifying any user lists all
users granted global permissions (grant 'user', 'RWXCA'):
{noformat}
hbase(main):008:0* user_permission
User
Namespace,Table,Family,Qualifier:Permission
@hbase-admin hbase,hbase:acl,,:
[Permission: actions=READ,WRITE,EXEC,CREATE,ADMIN]
1 row(s) in 3.1710 seconds
{noformat}
Users defined as super users on hbase-site.xml configuration file are not
listed by this same command, even though a super user has the same
permissions/privileges as those defined through grant 'user', 'RWXCA'
command on the shell:
{noformat}
property
namehbase.superuser/name
valuehbase-user/value
/property
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644373#comment-14644373
]
Anoop Sam John commented on HBASE-14155:
{code}
STATE tmp = previous;
previous = current;
current = tmp;
{code}
This was not enough? We need to specifically call setKey() again? Some thing
wrong in the overall flow then.. May be we need revisit this. Chances of
missing these kind of setters is more then..
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:449)
at
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645477#comment-14645477 ] Ashish Singhi commented on HBASE-14154: --- Thanks Andrew for the review. I have attached branch-1 and 0.98 version patches. DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-14154-0.98.patch, HBASE-14154-branch-1.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HBASE-14154: -- Attachment: HBASE-14154-0.98.patch Patch for 0.98 branch. DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-14154-0.98.patch, HBASE-14154-branch-1.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-7972) Add a configuration for the TCP backlog in the Thrift server
[ https://issues.apache.org/jira/browse/HBASE-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-7972: --- Fix Version/s: (was: 1.30) 1.3.0 Add a configuration for the TCP backlog in the Thrift server Key: HBASE-7972 URL: https://issues.apache.org/jira/browse/HBASE-7972 Project: HBase Issue Type: Improvement Components: Thrift Affects Versions: 2.0.0, 1.3.0 Reporter: Jean-Daniel Cryans Assignee: Esteban Gutierrez Labels: thrift, thrift2 Fix For: 2.0.0, 1.3.0 Once THRIFT-1868 goes in, we can start letting our users configure the TCP backlog. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-7972) Add a configuration for the TCP backlog in the Thrift server
[ https://issues.apache.org/jira/browse/HBASE-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-7972: --- Fix Version/s: 2.0.0 1.30 Add a configuration for the TCP backlog in the Thrift server Key: HBASE-7972 URL: https://issues.apache.org/jira/browse/HBASE-7972 Project: HBase Issue Type: Improvement Components: Thrift Affects Versions: 2.0.0, 1.3.0 Reporter: Jean-Daniel Cryans Assignee: Esteban Gutierrez Labels: thrift, thrift2 Fix For: 2.0.0, 1.3.0 Once THRIFT-1868 goes in, we can start letting our users configure the TCP backlog. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14125) HBase Backup/Restore Phase 2: Cancel backup
[ https://issues.apache.org/jira/browse/HBASE-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov updated HBASE-14125: -- Summary: HBase Backup/Restore Phase 2: Cancel backup (was: HBAse Backup/Restore Phase 2: Cancel backup) HBase Backup/Restore Phase 2: Cancel backup --- Key: HBASE-14125 URL: https://issues.apache.org/jira/browse/HBASE-14125 Project: HBase Issue Type: New Feature Reporter: Vladimir Rodionov Assignee: Vladimir Rodionov Cancel backup operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13992) Integrate SparkOnHBase into HBase
[ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644461#comment-14644461 ] Sean Busbey commented on HBASE-13992: - Looks good to me. As previously agreed I'll amend to up the javadoc warn count. Things fine by you [~ste...@apache.org]? Integrate SparkOnHBase into HBase - Key: HBASE-13992 URL: https://issues.apache.org/jira/browse/HBASE-13992 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Attachments: HBASE-13992.10.patch, HBASE-13992.11.patch, HBASE-13992.12.patch, HBASE-13992.5.patch, HBASE-13992.6.patch, HBASE-13992.7.patch, HBASE-13992.8.patch, HBASE-13992.9.patch, HBASE-13992.patch, HBASE-13992.patch.3, HBASE-13992.patch.4, HBASE-13992.patch.5 This Jira is to ask if SparkOnHBase can find a home in side HBase core. Here is the github: https://github.com/cloudera-labs/SparkOnHBase I am the core author of this project and the license is Apache 2.0 A blog explaining this project is here http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/ A spark Streaming example is here http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/ A real customer using this in produce is blogged here http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/ Please debate and let me know what I can do to make this happen. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-14152) Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339
[ https://issues.apache.org/jira/browse/HBASE-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey resolved HBASE-14152. - Resolution: Fixed reapplied with corrected commit message. Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339 - Key: HBASE-14152 URL: https://issues.apache.org/jira/browse/HBASE-14152 Project: HBase Issue Type: Improvement Components: mob Affects Versions: 2.0.0 Reporter: Jingcheng Du Assignee: Jingcheng Du Fix For: 2.0.0 Attachments: HBASE-14152-V2.patch, HBASE-14152-V3.patch, HBASE-14152.patch There are some new warnings in Checkstyle and FindBugs brought in by merging the feature branch hbase-11339 to trunk. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-3942) The thrift scannerOpen functions should support row caching
[ https://issues.apache.org/jira/browse/HBASE-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-3942: --- Assignee: Adam Warrington The thrift scannerOpen functions should support row caching --- Key: HBASE-3942 URL: https://issues.apache.org/jira/browse/HBASE-3942 Project: HBase Issue Type: Improvement Components: Thrift Affects Versions: 0.90.3 Reporter: Adam Warrington Assignee: Adam Warrington Priority: Minor Fix For: 0.92.0 Attachments: HBASE-3942-0.patch After noticing very poor scanner performance using the Thrift api, I realized that there was no way to set caching on the scanner. This should probably be supported. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-14152) Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339
[ https://issues.apache.org/jira/browse/HBASE-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey reopened HBASE-14152: - Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339 - Key: HBASE-14152 URL: https://issues.apache.org/jira/browse/HBASE-14152 Project: HBase Issue Type: Improvement Components: mob Affects Versions: 2.0.0 Reporter: Jingcheng Du Assignee: Jingcheng Du Fix For: 2.0.0 Attachments: HBASE-14152-V2.patch, HBASE-14152-V3.patch, HBASE-14152.patch There are some new warnings in Checkstyle and FindBugs brought in by merging the feature branch hbase-11339 to trunk. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13089) Fix test compilation error on building against htrace-3.2.0-incubating
[ https://issues.apache.org/jira/browse/HBASE-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-13089: Fix Version/s: 1.3.0 Fix test compilation error on building against htrace-3.2.0-incubating -- Key: HBASE-13089 URL: https://issues.apache.org/jira/browse/HBASE-13089 Project: HBase Issue Type: Task Reporter: Masatake Iwasaki Assignee: Esteban Gutierrez Priority: Minor Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13089.patch Test compilation fails if you use htrace-3.2.0 because Span.ROOT_SPAN_ID is removed. It is used in TestHTraceHooks and should be should be replaced on the next bumping of htrace version. This is not problem as far as htrace-3.1.0 is used. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13992) Integrate SparkOnHBase into HBase
[ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644580#comment-14644580 ] Steve Loughran commented on HBASE-13992: LGTM : I only worry about testability, and that's a good start. More tests will no doubt come over time ... something in Bigtop would be good for the integration Integrate SparkOnHBase into HBase - Key: HBASE-13992 URL: https://issues.apache.org/jira/browse/HBASE-13992 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Attachments: HBASE-13992.10.patch, HBASE-13992.11.patch, HBASE-13992.12.patch, HBASE-13992.5.patch, HBASE-13992.6.patch, HBASE-13992.7.patch, HBASE-13992.8.patch, HBASE-13992.9.patch, HBASE-13992.patch, HBASE-13992.patch.3, HBASE-13992.patch.4, HBASE-13992.patch.5 This Jira is to ask if SparkOnHBase can find a home in side HBase core. Here is the github: https://github.com/cloudera-labs/SparkOnHBase I am the core author of this project and the license is Apache 2.0 A blog explaining this project is here http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/ A spark Streaming example is here http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/ A real customer using this in produce is blogged here http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/ Please debate and let me know what I can do to make this happen. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14157) Interfaces implemented by subclasses should be checked when registering CoprocessorService
[
https://issues.apache.org/jira/browse/HBASE-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated HBASE-14157:
---
Attachment: 14157-v4.txt
Patch v4 addresses review comment.
I didn't use fail() since exception would automatically fail the test.
Interfaces implemented by subclasses should be checked when registering
CoprocessorService
--
Key: HBASE-14157
URL: https://issues.apache.org/jira/browse/HBASE-14157
Project: HBase
Issue Type: Bug
Reporter: Alok Lal
Assignee: Ted Yu
Fix For: 2.0.0, 1.2.0, 1.1.2, 1.3.0
Attachments: 14157-v1.txt, 14157-v2.txt, 14157-v2.txt, 14157-v3.txt,
14157-v4.txt
Alok reported seeing the following exception when subclass of class which
implements CoprocessorService is used for hbase.coprocessor.region.classes :
{code}
hbase(main):015:0 grant 'mktg1', 'RWC', 'iemployee'
ERROR: org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No
registered coprocessor service found for name AccessControlService in region
hbase:acl,,1437137157604.2daf735ea38da95e9ba249db6b63b79c.
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7367)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1873)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1855)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
{code}
The root cause is in the following code of RegionCoprocessorHost:
{code}
for (Class? c : implClass.getInterfaces()) {
if (CoprocessorService.class.isAssignableFrom(c)) {
region.registerService( ((CoprocessorService)instance).getService() );
}
}
{code}
We currently only check the interfaces directly implemented by the underlying
class.
What should be done is to check all the interfaces implemented by class
itself and its superclasses.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14057) HBase shell user_permission should list super users defined on hbase-site.xml
[
https://issues.apache.org/jira/browse/HBASE-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644307#comment-14644307
]
Hadoop QA commented on HBASE-14057:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747497/HBASE-14057.patch
against master branch at commit 89d04094626abebf279e9f64d597a7085bfc8fcf.
ATTACHMENT ID: 12747497
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14909//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14909//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14909//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14909//console
This message is automatically generated.
HBase shell user_permission should list super users defined on hbase-site.xml
-
Key: HBASE-14057
URL: https://issues.apache.org/jira/browse/HBASE-14057
Project: HBase
Issue Type: Task
Components: shell
Affects Versions: 1.0.1
Reporter: Wellington Chevreuil
Assignee: Srikanth Srungarapu
Priority: Minor
Attachments: HBASE-14057-branch-1.patch, HBASE-14057.patch
On HBase Shell, user_permission command without specifying any user lists all
users granted global permissions (grant 'user', 'RWXCA'):
{noformat}
hbase(main):008:0* user_permission
User
Namespace,Table,Family,Qualifier:Permission
@hbase-admin hbase,hbase:acl,,:
[Permission: actions=READ,WRITE,EXEC,CREATE,ADMIN]
1 row(s) in 3.1710 seconds
{noformat}
Users defined as super users on hbase-site.xml configuration file are not
listed by this same command, even though a super user has the same
permissions/privileges as those defined through grant 'user', 'RWXCA'
command on the shell:
{noformat}
property
namehbase.superuser/name
valuehbase-user/value
/property
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644288#comment-14644288
]
Hadoop QA commented on HBASE-14155:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747531/HBASE-14155.patch
against master branch at commit 89d04094626abebf279e9f64d597a7085bfc8fcf.
ATTACHMENT ID: 12747531
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.master.TestDistributedLogSplitting
{color:red}-1 core zombie tests{color}. There are 1 zombie test(s):
at
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2.testMRIncrementalLoadWithSplit(TestHFileOutputFormat2.java:385)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14906//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14906//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14906//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14906//console
This message is automatically generated.
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
[jira] [Commented] (HBASE-14057) HBase shell user_permission should list super users defined on hbase-site.xml
[
https://issues.apache.org/jira/browse/HBASE-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644301#comment-14644301
]
Hadoop QA commented on HBASE-14057:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747497/HBASE-14057.patch
against master branch at commit 89d04094626abebf279e9f64d597a7085bfc8fcf.
ATTACHMENT ID: 12747497
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14908//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14908//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14908//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14908//console
This message is automatically generated.
HBase shell user_permission should list super users defined on hbase-site.xml
-
Key: HBASE-14057
URL: https://issues.apache.org/jira/browse/HBASE-14057
Project: HBase
Issue Type: Task
Components: shell
Affects Versions: 1.0.1
Reporter: Wellington Chevreuil
Assignee: Srikanth Srungarapu
Priority: Minor
Attachments: HBASE-14057-branch-1.patch, HBASE-14057.patch
On HBase Shell, user_permission command without specifying any user lists all
users granted global permissions (grant 'user', 'RWXCA'):
{noformat}
hbase(main):008:0* user_permission
User
Namespace,Table,Family,Qualifier:Permission
@hbase-admin hbase,hbase:acl,,:
[Permission: actions=READ,WRITE,EXEC,CREATE,ADMIN]
1 row(s) in 3.1710 seconds
{noformat}
Users defined as super users on hbase-site.xml configuration file are not
listed by this same command, even though a super user has the same
permissions/privileges as those defined through grant 'user', 'RWXCA'
command on the shell:
{noformat}
property
namehbase.superuser/name
valuehbase-user/value
/property
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645392#comment-14645392 ] Hudson commented on HBASE-14086: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1016 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1016/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 89dee23bfcf1df6810121ab43c6499f940b1f82a) * src/main/asciidoc/asciidoctor.css * pom.xml * src/main/site/resources/css/freebsd_docbook.css remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14097) Log link to client scan troubleshooting section when scanner exceptions happen.
[ https://issues.apache.org/jira/browse/HBASE-14097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645393#comment-14645393 ] Hudson commented on HBASE-14097: SUCCESS: Integrated in HBase-1.3-IT #60 (See [https://builds.apache.org/job/HBase-1.3-IT/60/]) HBASE-14097 Log link to client scan troubleshooting section when scanner exceptions happen. (ssrungarapu: rev d1ff4cb2c1ee4d2313d83e8fc9129f5565f2a2aa) * hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java Log link to client scan troubleshooting section when scanner exceptions happen. --- Key: HBASE-14097 URL: https://issues.apache.org/jira/browse/HBASE-14097 Project: HBase Issue Type: Improvement Reporter: Srikanth Srungarapu Assignee: Srikanth Srungarapu Priority: Trivial Fix For: 2.0.0, 1.3.0 Attachments: HBASE-14097.patch As per description. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francis Liu updated HBASE-6721: --- Attachment: HBASE-6721_11.patch Rebased patch. RegionServer Group based Assignment --- Key: HBASE-6721 URL: https://issues.apache.org/jira/browse/HBASE-6721 Project: HBase Issue Type: New Feature Reporter: Francis Liu Assignee: Francis Liu Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation. The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well. This is essentially a simplification of the approach taken in HBASE-4120. See attached document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645396#comment-14645396 ] Francis Liu commented on HBASE-6721: [~apurtell] I rebased the patch onto trunk. This should be good enough to commit to a branch. RegionServer Group based Assignment --- Key: HBASE-6721 URL: https://issues.apache.org/jira/browse/HBASE-6721 Project: HBase Issue Type: New Feature Reporter: Francis Liu Assignee: Francis Liu Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation. The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well. This is essentially a simplification of the approach taken in HBASE-4120. See attached document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-6721) RegionServer Group based Assignment
[
https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645446#comment-14645446
]
Hadoop QA commented on HBASE-6721:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747704/HBASE-6721_11.patch
against master branch at commit 05de2ec5801fbba4577fb363f858a6e6f282c104.
ATTACHMENT ID: 12747704
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 30 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated 6
warning messages.
{color:red}-1 checkstyle{color}. The applied patch generated
1908 checkstyle errors (more than the master's current 1864 errors).
{color:red}-1 InterfaceAudience{color}. The patch appears
to contain InterfaceAudience from hadoop rather than hbase:
+import org.apache.hadoop.classification.InterfaceAudience;
+import org.apache.hadoop.classification.InterfaceStability;
+import org.apache.hadoop.classification.InterfaceAudience;
+import org.apache.hadoop.classification.InterfaceAudience;.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:red}-1 release audit{color}. The applied patch generated 1 release
audit warnings (more than the master's current 0 warnings).
{color:red}-1 lineLengths{color}. The patch introduces the following lines
longer than 100:
+ * coderpc
getLastMajorCompactionTimestamp(.hbase.pb.MajorCompactionTimestampRequest)
returns (.hbase.pb.MajorCompactionTimestampResponse);/code
+ * coderpc
getLastMajorCompactionTimestampForRegion(.hbase.pb.MajorCompactionTimestampForRegionRequest)
returns (.hbase.pb.MajorCompactionTimestampResponse);/code
+ * coderpc getProcedureResult(.hbase.pb.GetProcedureResultRequest)
returns (.hbase.pb.GetProcedureResultResponse);/code
+ * coderpc GetGroupInfo(.hbase.pb.GetGroupInfoRequest) returns
(.hbase.pb.GetGroupInfoResponse);/code
+ * coderpc GetGroupInfoOfTable(.hbase.pb.GetGroupInfoOfTableRequest)
returns (.hbase.pb.GetGroupInfoOfTableResponse);/code
+ * coderpc GetGroupInfoOfServer(.hbase.pb.GetGroupInfoOfServerRequest)
returns (.hbase.pb.GetGroupInfoOfServerResponse);/code
+ * coderpc MoveServers(.hbase.pb.MoveServersRequest) returns
(.hbase.pb.MoveServersResponse);/code
+ * coderpc MoveTables(.hbase.pb.MoveTablesRequest) returns
(.hbase.pb.MoveTablesResponse);/code
+ * coderpc RemoveGroup(.hbase.pb.RemoveGroupRequest) returns
(.hbase.pb.RemoveGroupResponse);/code
+ * coderpc BalanceGroup(.hbase.pb.BalanceGroupRequest) returns
(.hbase.pb.BalanceGroupResponse);/code
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//testReport/
Release audit warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//artifact/patchprocess/patchReleaseAuditWarnings.txt
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//artifact/patchprocess/checkstyle-aggregate.html
Javadoc warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//artifact/patchprocess/patchJavadocWarnings.txt
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14922//console
This message is automatically generated.
RegionServer Group based Assignment
---
Key: HBASE-6721
URL: https://issues.apache.org/jira/browse/HBASE-6721
Project: HBase
Issue Type: New Feature
Reporter: Francis Liu
Assignee: Francis Liu
Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf,
HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf,
HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch,
HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch,
HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch,
HBASE-6721_94_3.patch, HBASE-6721_94_4.patch,
[jira] [Updated] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HBASE-14154: -- Attachment: HBASE-14154-branch-1.patch Patch for branch-1 DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-14154-branch-1.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14097) Log link to client scan troubleshooting section when scanner exceptions happen.
[ https://issues.apache.org/jira/browse/HBASE-14097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645405#comment-14645405 ] Hudson commented on HBASE-14097: FAILURE: Integrated in HBase-1.3 #77 (See [https://builds.apache.org/job/HBase-1.3/77/]) HBASE-14097 Log link to client scan troubleshooting section when scanner exceptions happen. (ssrungarapu: rev d1ff4cb2c1ee4d2313d83e8fc9129f5565f2a2aa) * hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java Log link to client scan troubleshooting section when scanner exceptions happen. --- Key: HBASE-14097 URL: https://issues.apache.org/jira/browse/HBASE-14097 Project: HBase Issue Type: Improvement Reporter: Srikanth Srungarapu Assignee: Srikanth Srungarapu Priority: Trivial Fix For: 2.0.0, 1.3.0 Attachments: HBASE-14097.patch As per description. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14086) remove unused bundled dependencies
[ https://issues.apache.org/jira/browse/HBASE-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645390#comment-14645390 ] Hudson commented on HBASE-14086: SUCCESS: Integrated in HBase-1.2-IT #67 (See [https://builds.apache.org/job/HBase-1.2-IT/67/]) HBASE-14086 remove unused bundled dependencies (busbey: rev 78842f94963c3cd8a047895e523edcd08ad4af22) * src/main/asciidoc/asciidoctor.css * src/main/site/resources/css/freebsd_docbook.css * pom.xml remove unused bundled dependencies -- Key: HBASE-14086 URL: https://issues.apache.org/jira/browse/HBASE-14086 Project: HBase Issue Type: Sub-task Components: documentation Reporter: Sean Busbey Assignee: Sean Busbey Priority: Blocker Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0 Attachments: HBASE-14086.1.patch We have some files with compatible non-ASL licenses that don't appear to be used, so remove them. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14164) Display primary region replicas distribution on table.jsp
[
https://issues.apache.org/jira/browse/HBASE-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645434#comment-14645434
]
Hadoop QA commented on HBASE-14164:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747688/14164-v2.txt
against master branch at commit 05de2ec5801fbba4577fb363f858a6e6f282c104.
ATTACHMENT ID: 12747688
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14919//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14919//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14919//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14919//console
This message is automatically generated.
Display primary region replicas distribution on table.jsp
-
Key: HBASE-14164
URL: https://issues.apache.org/jira/browse/HBASE-14164
Project: HBase
Issue Type: Improvement
Reporter: Ted Yu
Assignee: Ted Yu
Priority: Minor
Attachments: 14164-v1.txt, 14164-v2.txt, 14164-v2.txt,
table-with-primary.png
While working on HBASE-14110, I enhanced table.jsp with display of primary
region replicas across region servers.
This gives user clear idea on the distribution of primary replicas.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
Ted Malaska created HBASE-14158: --- Summary: Add documentation for Initial Release for HBase-Spark Module integration Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Reporter: Ted Malaska Assignee: Ted Malaska Priority: Minor Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13089) Fix test compilation error on building against htrace-3.2.0-incubating
[ https://issues.apache.org/jira/browse/HBASE-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644643#comment-14644643 ] Hudson commented on HBASE-13089: SUCCESS: Integrated in HBase-1.3-IT #58 (See [https://builds.apache.org/job/HBase-1.3-IT/58/]) HBASE-13089 Fix test compilation error on building against htrace-3.2.0-incubating (busbey: rev 8764b9fd8068385dc339f6f81d4e50c5b5882abe) * hbase-server/src/test/java/org/apache/hadoop/hbase/trace/TestHTraceHooks.java Fix test compilation error on building against htrace-3.2.0-incubating -- Key: HBASE-13089 URL: https://issues.apache.org/jira/browse/HBASE-13089 Project: HBase Issue Type: Task Reporter: Masatake Iwasaki Assignee: Esteban Gutierrez Priority: Minor Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13089.patch Test compilation fails if you use htrace-3.2.0 because Span.ROOT_SPAN_ID is removed. It is used in TestHTraceHooks and should be should be replaced on the next bumping of htrace version. This is not problem as far as htrace-3.1.0 is used. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14159) Resolve warning introduced by HBase-Spark module
Ted Malaska created HBASE-14159: --- Summary: Resolve warning introduced by HBase-Spark module Key: HBASE-14159 URL: https://issues.apache.org/jira/browse/HBASE-14159 Project: HBase Issue Type: Improvement Reporter: Ted Malaska Assignee: Sean Busbey Priority: Minor Fix the following warning that is a result of something in the modules pom file [WARNING] warning: Class org.apache.hadoop.mapred.MiniMRCluster not found - continuing with a stub. [WARNING] one warning found -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14158: Fix Version/s: 2.0.0 Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14150) Add BulkLoad functionality to HBase-Spark Module
[ https://issues.apache.org/jira/browse/HBASE-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14150: Component/s: spark Add BulkLoad functionality to HBase-Spark Module Key: HBASE-14150 URL: https://issues.apache.org/jira/browse/HBASE-14150 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Add on to the work done in HBASE-13992 to add functionality to do a bulk load from a given RDD. This will do the following: 1. figure out the number of regions and sort and partition the data correctly to be written out to HFiles 2. Also unlike the MR bulkload I would like that the columns to be sorted in the shuffle stage and not in the memory of the reducer. This will allow this design to support super wide records with out going out of memory. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14157) Interfaces implemented by subclasses should be checked when registering CoprocessorService
[
https://issues.apache.org/jira/browse/HBASE-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644694#comment-14644694
]
Ted Yu commented on HBASE-14157:
TestDistributedLogSplitting failure is not related to the patch.
Interfaces implemented by subclasses should be checked when registering
CoprocessorService
--
Key: HBASE-14157
URL: https://issues.apache.org/jira/browse/HBASE-14157
Project: HBase
Issue Type: Bug
Reporter: Alok Lal
Assignee: Ted Yu
Fix For: 2.0.0, 1.2.0, 1.1.2, 1.3.0
Attachments: 14157-v1.txt, 14157-v2.txt, 14157-v2.txt, 14157-v3.txt,
14157-v4.txt
Alok reported seeing the following exception when subclass of class which
implements CoprocessorService is used for hbase.coprocessor.region.classes :
{code}
hbase(main):015:0 grant 'mktg1', 'RWC', 'iemployee'
ERROR: org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No
registered coprocessor service found for name AccessControlService in region
hbase:acl,,1437137157604.2daf735ea38da95e9ba249db6b63b79c.
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7367)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1873)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1855)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
{code}
The root cause is in the following code of RegionCoprocessorHost:
{code}
for (Class? c : implClass.getInterfaces()) {
if (CoprocessorService.class.isAssignableFrom(c)) {
region.registerService( ((CoprocessorService)instance).getService() );
}
}
{code}
We currently only check the interfaces directly implemented by the underlying
class.
What should be done is to check all the interfaces implemented by class
itself and its superclasses.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14158: Priority: Major (was: Minor) Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HBASE-14154: -- Fix Version/s: 1.3.0 2.0.0 DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 1.3.0 Attachments: HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14159) Resolve warning introduced by HBase-Spark module
[ https://issues.apache.org/jira/browse/HBASE-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14159: Component/s: spark build Resolve warning introduced by HBase-Spark module Key: HBASE-14159 URL: https://issues.apache.org/jira/browse/HBASE-14159 Project: HBase Issue Type: Improvement Components: build, spark Reporter: Ted Malaska Assignee: Sean Busbey Priority: Minor Fix For: 2.0.0 Fix the following warning that is a result of something in the modules pom file [WARNING] warning: Class org.apache.hadoop.mapred.MiniMRCluster not found - continuing with a stub. [WARNING] one warning found -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14159) Resolve warning introduced by HBase-Spark module
[ https://issues.apache.org/jira/browse/HBASE-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14159: Fix Version/s: 2.0.0 Resolve warning introduced by HBase-Spark module Key: HBASE-14159 URL: https://issues.apache.org/jira/browse/HBASE-14159 Project: HBase Issue Type: Improvement Components: build, spark Reporter: Ted Malaska Assignee: Sean Busbey Priority: Minor Fix For: 2.0.0 Fix the following warning that is a result of something in the modules pom file [WARNING] warning: Class org.apache.hadoop.mapred.MiniMRCluster not found - continuing with a stub. [WARNING] one warning found -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14161) Add hbase-spark integration tests to IT jenkins job
Sean Busbey created HBASE-14161: --- Summary: Add hbase-spark integration tests to IT jenkins job Key: HBASE-14161 URL: https://issues.apache.org/jira/browse/HBASE-14161 Project: HBase Issue Type: Task Components: build Reporter: Sean Busbey Assignee: Sean Busbey Fix For: 2.0.0 expand the set of ITs we run to include the new hbase-spark tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14162) regenerating thrift classes fails against 0.9.2
Sean Busbey created HBASE-14162:
---
Summary: regenerating thrift classes fails against 0.9.2
Key: HBASE-14162
URL: https://issues.apache.org/jira/browse/HBASE-14162
Project: HBase
Issue Type: Bug
Components: build, Thrift
Affects Versions: 2.0.0, 1.3.0
Reporter: Sean Busbey
Assignee: Srikanth Srungarapu
Priority: Blocker
Fix For: 2.0.0, 1.3.0
HBASE-14045 updated the thrift version, but our enforcer rule is still checking
0.9.0.
{code}
$ git checkout master
Switched to branch 'master'
Your branch is up-to-date with 'origin/master'.
$ mvn compile -Pcompile-thrift -DskipTests
[INFO] Scanning for projects...
... SNIP ...
[INFO]
[INFO] Building HBase - Thrift 2.0.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ hbase-thrift ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-thrift-version) @
hbase-thrift ---
[WARNING] Rule 0: org.apache.maven.plugins.enforcer.RequireProperty failed with
message:
-
-
[FATAL]
==
[FATAL] HBase Thrift requires the thrift generator version 0.9.0.
[FATAL] Setting it to something else needs to be reviewed for wire and behavior
compatibility.
[FATAL]
==
-
-
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] HBase .. SUCCESS [ 2.897 s]
[INFO] HBase - Checkstyle . SUCCESS [ 0.554 s]
[INFO] HBase - Annotations SUCCESS [ 0.940 s]
[INFO] HBase - Protocol ... SUCCESS [ 15.454 s]
[INFO] HBase - Common . SUCCESS [ 8.984 s]
[INFO] HBase - Procedure .. SUCCESS [ 1.982 s]
[INFO] HBase - Client . SUCCESS [ 6.805 s]
[INFO] HBase - Hadoop Compatibility ... SUCCESS [ 0.202 s]
[INFO] HBase - Hadoop Two Compatibility ... SUCCESS [ 1.393 s]
[INFO] HBase - Prefix Tree SUCCESS [ 1.233 s]
[INFO] HBase - Server . SUCCESS [ 13.841 s]
[INFO] HBase - Testing Util ... SUCCESS [ 2.979 s]
[INFO] HBase - Thrift . FAILURE [ 0.234 s]
[INFO] HBase - Shell .. SKIPPED
[INFO] HBase - Integration Tests .. SKIPPED
[INFO] HBase - Examples ... SKIPPED
[INFO] HBase - Rest ... SKIPPED
[INFO] HBase - Assembly ... SKIPPED
[INFO] HBase - Shaded . SKIPPED
[INFO] HBase - Shaded - Client SKIPPED
[INFO] HBase - Shaded - Server SKIPPED
[INFO] Apache HBase - Spark ... SKIPPED
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 01:00 min
[INFO] Finished at: 2015-07-28T12:36:15-05:00
[INFO] Final Memory: 84M/1038M
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce
(enforce-thrift-version) on project hbase-thrift: Some Enforcer rules have
failed. Look above for specific messages explaining why the rule failed. -
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn goals -rf :hbase-thrift
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-13992) Integrate SparkOnHBase into HBase
[ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-13992: Resolution: Fixed Release Note: This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings: * Support for Spark and Spark Streaming against Spark 1.3 * RDD/DStream formation from scan operations * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance * examples in both the Spark Java API and Spark Scala API * support for running against a secure HBase cluster Status: Resolved (was: Patch Available) pushed to master. Thanks [~ted.m]! I've included a brief release note. If folks think there's something it needs added let me know. Integrate SparkOnHBase into HBase - Key: HBASE-13992 URL: https://issues.apache.org/jira/browse/HBASE-13992 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Attachments: HBASE-13992.10.patch, HBASE-13992.11.patch, HBASE-13992.12.patch, HBASE-13992.5.patch, HBASE-13992.6.patch, HBASE-13992.7.patch, HBASE-13992.8.patch, HBASE-13992.9.patch, HBASE-13992.patch, HBASE-13992.patch.3, HBASE-13992.patch.4, HBASE-13992.patch.5 This Jira is to ask if SparkOnHBase can find a home in side HBase core. Here is the github: https://github.com/cloudera-labs/SparkOnHBase I am the core author of this project and the license is Apache 2.0 A blog explaining this project is here http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/ A spark Streaming example is here http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/ A real customer using this in produce is blogged here http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/ Please debate and let me know what I can do to make this happen. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14158: Component/s: spark documentation Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Priority: Minor Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13089) Fix test compilation error on building against htrace-3.2.0-incubating
[ https://issues.apache.org/jira/browse/HBASE-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644646#comment-14644646 ] Hudson commented on HBASE-13089: FAILURE: Integrated in HBase-1.3 #74 (See [https://builds.apache.org/job/HBase-1.3/74/]) HBASE-13089 Fix test compilation error on building against htrace-3.2.0-incubating (busbey: rev 8764b9fd8068385dc339f6f81d4e50c5b5882abe) * hbase-server/src/test/java/org/apache/hadoop/hbase/trace/TestHTraceHooks.java Fix test compilation error on building against htrace-3.2.0-incubating -- Key: HBASE-13089 URL: https://issues.apache.org/jira/browse/HBASE-13089 Project: HBase Issue Type: Task Reporter: Masatake Iwasaki Assignee: Esteban Gutierrez Priority: Minor Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13089.patch Test compilation fails if you use htrace-3.2.0 because Span.ROOT_SPAN_ID is removed. It is used in TestHTraceHooks and should be should be replaced on the next bumping of htrace version. This is not problem as far as htrace-3.1.0 is used. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14160) backport hbase-spark module to branch-1
Sean Busbey created HBASE-14160: --- Summary: backport hbase-spark module to branch-1 Key: HBASE-14160 URL: https://issues.apache.org/jira/browse/HBASE-14160 Project: HBase Issue Type: New Feature Components: spark Affects Versions: 1.3.0 Reporter: Sean Busbey Fix For: 1.3.0 Once the hbase-spark module gets polished a bit, we should backport to branch-1 so we can publish it sooner. needs (per previous discussion): * examples refactored into different module * user facing documentation * defined public API -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14024) ImportTsv is not loading hbase-default.xml
[
https://issues.apache.org/jira/browse/HBASE-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644658#comment-14644658
]
Ashish Singhi commented on HBASE-14024:
---
{quote}
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.client.TestReplicasClient
-1 core zombie tests. There are 3 zombie test(s): at
org.apache.camel.test.spring.CamelSpringTestSupport.doCreateApplicationContext(CamelSpringTestSupport.java:90)
at
org.apache.camel.test.spring.CamelSpringTestSupport.doPreSetup(CamelSpringTestSupport.java:80)
at
org.apache.camel.test.junit4.CamelTestSupport.setUp(CamelTestSupport.java:216)
at
org.apache.camel.component.jetty.jettyproducer.HttpJettyProducerRecipientListCustomThreadPoolTest.testRecipientList(HttpJettyProducerRecipientListCustomThreadPoolTest.java:40)
{quote}
Not related to the patch.
ImportTsv is not loading hbase-default.xml
--
Key: HBASE-14024
URL: https://issues.apache.org/jira/browse/HBASE-14024
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 2.0.0
Reporter: Ashish Singhi
Assignee: Ashish Singhi
Priority: Critical
Fix For: 2.0.0
Attachments: HBASE-14024(1).patch, HBASE-14024(2) .patch,
HBASE-14024.patch
ImportTsv job is failing with below exception
{noformat}
Exception in thread main java.lang.IllegalArgumentException: Can not create
a Path from a null string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:123)
at org.apache.hadoop.fs.Path.init(Path.java:135)
at org.apache.hadoop.fs.Path.init(Path.java:89)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configurePartitioner(HFileOutputFormat2.java:591)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:441)
at
org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:406)
at
org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:555)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:763)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:772)
{noformat}
{{hbase.fs.tmp.dir}} is set to a default value in hbase-default.xml.
I found that hbase configuration resources from its xml are not loaded into
conf object.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14157) Interfaces implemented by subclasses should be checked when registering CoprocessorService
[
https://issues.apache.org/jira/browse/HBASE-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644686#comment-14644686
]
Hadoop QA commented on HBASE-14157:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747568/14157-v4.txt
against master branch at commit 89d04094626abebf279e9f64d597a7085bfc8fcf.
ATTACHMENT ID: 12747568
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.master.TestDistributedLogSplitting
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14911//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14911//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14911//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14911//console
This message is automatically generated.
Interfaces implemented by subclasses should be checked when registering
CoprocessorService
--
Key: HBASE-14157
URL: https://issues.apache.org/jira/browse/HBASE-14157
Project: HBase
Issue Type: Bug
Reporter: Alok Lal
Assignee: Ted Yu
Fix For: 2.0.0, 1.2.0, 1.1.2, 1.3.0
Attachments: 14157-v1.txt, 14157-v2.txt, 14157-v2.txt, 14157-v3.txt,
14157-v4.txt
Alok reported seeing the following exception when subclass of class which
implements CoprocessorService is used for hbase.coprocessor.region.classes :
{code}
hbase(main):015:0 grant 'mktg1', 'RWC', 'iemployee'
ERROR: org.apache.hadoop.hbase.exceptions.UnknownProtocolException: No
registered coprocessor service found for name AccessControlService in region
hbase:acl,,1437137157604.2daf735ea38da95e9ba249db6b63b79c.
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7367)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1873)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1855)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
{code}
The root cause is in the following code of RegionCoprocessorHost:
{code}
for (Class? c : implClass.getInterfaces()) {
if (CoprocessorService.class.isAssignableFrom(c)) {
region.registerService( ((CoprocessorService)instance).getService() );
}
}
{code}
We currently only check the interfaces directly implemented by the underlying
class.
What should be done is to check all the interfaces implemented by class
itself and its superclasses.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14155) StackOverflowError in reverse scan
[
https://issues.apache.org/jira/browse/HBASE-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644665#comment-14644665
]
ramkrishna.s.vasudevan commented on HBASE-14155:
bq.Some thing wrong in the overall flow then.. May be we need revisit this
Revisiting this place is fine. But I think, with the current way we have to do
this setKey because in copyFromNext the keyBuffer is deep copied and the
current's reference is updated.
So when we moveToPrevious() though the keyBuffer is independent the current (as
ref) is already updated. So we need to set the current keyBuffer to the current
reference.
In 0.98 cases we were doing a full copy of the key and value so it was fine.
Correct me if am wrong.
StackOverflowError in reverse scan
--
Key: HBASE-14155
URL: https://issues.apache.org/jira/browse/HBASE-14155
Project: HBase
Issue Type: Bug
Components: regionserver, Scanners
Affects Versions: 1.1.0
Reporter: James Taylor
Assignee: ramkrishna.s.vasudevan
Priority: Critical
Labels: Phoenix
Attachments: HBASE-14155.patch, ReproReverseScanStackOverflow.java,
ReproReverseScanStackOverflowCoprocessor.java
A stack overflow may occur when a reverse scan is done. To reproduce (on a
Mac), use the following steps:
- Download the Phoenix 4.5.0 RC here:
https://dist.apache.org/repos/dist/dev/phoenix/phoenix-4.5.0-HBase-1.1-rc0/bin/
- Copy the phoenix-4.5.0-HBase-1.1-server.jar into the HBase lib directory
(removing any earlier Phoenix version if there was one installed)
- Stop and restart HBase
- From the bin directory of the Phoenix binary distribution, start sqlline
like this: ./sqlline.py localhost
- Create a new table and populate it like this:
{code}
create table desctest (k varchar primary key desc);
upsert into desctest values ('a');
upsert into desctest values ('ab');
upsert into desctest values ('b');
{code}
- Note that the following query works fine at this point:
{code}
select * from desctest order by k;
+--+
|K |
+--+
| a|
| ab |
| b|
+--+
{code}
- Stop and start HBase
- Rerun the above query again and you'll get a StackOverflowError at
StoreFileScanner.seekToPreviousRow()
{code}
select * from desctest order by k;
java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
DESCTEST,,1437847235264.a74d70e6a8b36e24d1ea1a70edb0cdf7.: null
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
at
org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
at
org.apache.phoenix.coprocessor.BaseScannerRegionObserver$2.nextRaw(BaseScannerRegionObserver.java:352)
at
org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2393)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.StackOverflowError
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numChunks(ChecksumUtil.java:201)
at
org.apache.hadoop.hbase.io.hfile.ChecksumUtil.numBytes(ChecksumUtil.java:189)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.totalChecksumBytes(HFileBlock.java:1826)
at
org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:356)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getEncodedBuffer(HFileReaderV2.java:1211)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.getFirstKeyInBlock(HFileReaderV2.java:1307)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:657)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekBefore(HFileReaderV2.java:646)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekToPreviousRow(StoreFileScanner.java:425)
at
[jira] [Updated] (HBASE-14149) Add Data Frame support for HBase-Spark Module
[ https://issues.apache.org/jira/browse/HBASE-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14149: Component/s: spark Add Data Frame support for HBase-Spark Module - Key: HBASE-14149 URL: https://issues.apache.org/jira/browse/HBASE-14149 Project: HBase Issue Type: New Feature Components: spark Reporter: Ted Malaska Assignee: Ted Malaska Add on to the work done in HBASE-13992 and add support for dataframes for bulk puts, bulk gets, and scans -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644651#comment-14644651 ] Sean Busbey commented on HBASE-14158: - upped the priority to Major, since this is a prereq for backporting hbase-spark to branch-1. Add documentation for Initial Release for HBase-Spark Module integration - Key: HBASE-14158 URL: https://issues.apache.org/jira/browse/HBASE-14158 Project: HBase Issue Type: Improvement Components: documentation, spark Reporter: Ted Malaska Assignee: Ted Malaska Fix For: 2.0.0 Add documentation for Initial Release for HBase-Spark Module integration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
