[
https://issues.apache.org/jira/browse/HIVE-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Denys Kuzmenko updated HIVE-27558:
----------------------------------
Description:
{code}
INSERT INTO TABLE target_tbl
SELECT
...
FROM
(
SELECT
...
FROM
hbase_tbl
WHERE
CDS_PK >= '2-00OZG-0'
and CDS_PK <= '2-00OZG-g'
) CDS_VIEW;
{code}
The statement predicate is not pushed to the storage lager causing the job to
execute longer than it needs to.
Possible solutions:
1. Support pushing down BETWEEN clause to HBaseStorageHandler
2. Don't convert specific filters on key column incase of HBaseStorageHandler
or don't apply this optimization for HBaseStorageHandler tables.
was:
INSERT INTO TABLE target_tbl
SELECT
...
FROM
(
SELECT
...
FROM
hbase_tbl
WHERE
CDS_PK >= '2-00OZG-0'
and CDS_PK <= '2-00OZG-g'
) CDS_VIEW;
The statement predicate is not pushed to the storage lager causing the job to
execute longer than it needs to.
Possible solutions:
1. Support pushing down BETWEEN clause to HBaseStorageHandler
2. Don't convert specific filters on key column incase of HBaseStorageHandler
or don't apply this optimization for HBaseStorageHandler tables.
> HBase table query does not push BETWEEN predicate to storage layer
> ------------------------------------------------------------------
>
> Key: HIVE-27558
> URL: https://issues.apache.org/jira/browse/HIVE-27558
> Project: Hive
> Issue Type: Task
> Reporter: Denys Kuzmenko
> Priority: Major
>
> {code}
> INSERT INTO TABLE target_tbl
> SELECT
> ...
> FROM
> (
> SELECT
> ...
> FROM
> hbase_tbl
> WHERE
> CDS_PK >= '2-00OZG-0'
> and CDS_PK <= '2-00OZG-g'
> ) CDS_VIEW;
> {code}
> The statement predicate is not pushed to the storage lager causing the job to
> execute longer than it needs to.
> Possible solutions:
> 1. Support pushing down BETWEEN clause to HBaseStorageHandler
> 2. Don't convert specific filters on key column incase of HBaseStorageHandler
> or don't apply this optimization for HBaseStorageHandler tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
