[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159572#comment-14159572
]
Muhammad Ehsan ul Haque commented on HIVE-8267:
---
Gentle reminder!, please let me know if something else need to be done/fixed
for this patch.
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159787#comment-14159787
]
Navis commented on HIVE-8267:
-
[~ehsan] Wishfully. But patches on hbase-handler have not been welcomed by
other committers.
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156476#comment-14156476
]
Muhammad Ehsan ul Haque commented on HIVE-8267:
---
[~navis] I saw pre commit tests passed on HIVE-2828, so is that and this are
ready to ship?
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154509#comment-14154509
]
Muhammad Ehsan ul Haque commented on HIVE-8267:
---
Thanks [~leftylev]
[~navis] In that case yes it can be considered as a sequel of HIVE-2828.
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153794#comment-14153794
]
Muhammad Ehsan ul Haque commented on HIVE-8267:
---
[~navis] do you need more information on that?
Also can you tell me how to get access to edit the confluence page [Hive HBase
Integration|https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration]?
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153801#comment-14153801
]
Lefty Leverenz commented on HIVE-8267:
--
Here's how you get edit access:
* [About This Wiki -- How to get permission to edit |
https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki#AboutThisWiki-Howtogetpermissiontoedit]
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154347#comment-14154347
]
Navis commented on HIVE-8267:
-
[~ehsan] I got it. The last test result of HIVE-2828 shows fail of
TestHS2ImpersonationWithRemoteMS.testImpersonation, but seemed not related to.
And the reason of using timestamp of first cell is that it was enough for our
use cases in that time (and it's fast), accessing rows always via hive. But
things can be different if it's updated directly from hbase client. Can I
regard this as a following issue of HIVE-2828?
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151403#comment-14151403
]
Navis commented on HIVE-8267:
-
[~ehsan] HIVE-2781 is applied long ago and HIVE-2828 is not broken (can have
restricted feature). Could I ask the reason why you stated like that?
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151623#comment-14151623
]
Muhammad Ehsan ul Haque commented on HIVE-8267:
---
My bad I just copy pasted from HIVE-2828 description (Originated from HIVE-2781
and not accepted, but I think this could be helpful to someone). However there
is one more HIVE-2306 still open, no patch available.
Hive-2828, has failing test after 2.5 year rebase. Also exposes timestamp by
picking the timestamp of the first cell only.
{code}
long timestamp = result.rawCells()[0].getTimestamp();
{code}
Does not allow to expose timestamp of all or particular cells in some column
families.
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8267) Exposing hbase cell latest timestamp through hbase columns mappings to hive columns.
[
https://issues.apache.org/jira/browse/HIVE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150513#comment-14150513
]
Hive QA commented on HIVE-8267:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12671425/HIVE-8267.0.patch
{color:green}SUCCESS:{color} +1 6368 tests passed
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1009/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1009/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1009/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12671425
Exposing hbase cell latest timestamp through hbase columns mappings to hive
columns.
Key: HIVE-8267
URL: https://issues.apache.org/jira/browse/HIVE-8267
Project: Hive
Issue Type: New Feature
Components: HBase Handler
Affects Versions: 0.14.0
Reporter: Muhammad Ehsan ul Haque
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-8267.0.patch
Previous attempts HIVE-2781 (not accepted), HIVE-2828 (broken and proposed
with restricted feature).
The feature is to have hbase cell latest timestamp accessible in hive query,
by mapping the cell timestamp with a hive column, using mapping format like
{code}:timestamp:cf:[optional qualifier or qualifier prefix]{code}
The hive create table statement would be like
h4. For mapping a cell latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, col1 STRING, col1_ts BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:qualifier,
:timestamp:cf:qualifier)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. For mapping a column family latest timestamp.
{code}
CREATE TABLE hive_hbase_table (key STRING, valuemap MAPSTRING, STRING,
timestampmap MAPSTRING, BIGINT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf:,:timestamp:cf:)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
h4. Providing default cell value
{code}
CREATE TABLE hive_hbase_table(key int, value string, value_timestamp bigint)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping = cf:qualifier,
:timestamp:cf:qualifier,
hbase.put.default.cell.value = default value)
TBLPROPERTIES (hbase.table.name = hbase_table);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
