[ 
https://issues.apache.org/jira/browse/HIVE-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

WangMeng updated HIVE-11880:
----------------------------
    Description: 
   For UNION ALL , when an union operator is constant column (such as '0L', 
BIGINT Type)  and its corresponding column has incompatible type (such as INT 
type). 
  Query with filter condition on type incompatible column on this UNION ALL  
will cause IndexOutOfBoundsException.

 Such as TPC-H table "orders",in  the following query:
 Type of 'orders'.'o_custkey' is INT normally,  while  the type of 
corresponding constant column  "0" is BIGINT( `0L AS `o_custkey` ). 
 This query (with filter "type incompatible column 'o_custkey' ")  will fail  
with  java.lang.IndexOutOfBoundsException : 
{code}
SELECT Count(1)
FROM   (
              SELECT `o_orderkey` ,
                     `o_custkey`
              FROM   `orders`
              UNION ALL
              SELECT `o_orderkey`,
                     0L  AS `o_custkey`
              FROM   `orders`) `oo`
WHERE  o_custkey<100000 limit 4 ;
{code}
When 
{code}
set hive.ppd.remove.duplicatefilters=true
{code}

  was:
   For UNION ALL , when an union operator is constant(column 'a' such as '0L')  
and it has incompatible type with the corresponding column A(INT type). 
  Query with filter condition on type incompatible column on this UNION ALL  
will cause IndexOutOfBoundsException.

 Such as TPC-H table "orders",in  the fllowing query:
 Type of 'o_custkey' is INT normally,  while  the type of corresponding column 
constant "0" is BIGINT( `0L AS `o_custkey` ). 
 This query (with filter " incompatible column 'o_custkey' ")  will fail  with  
java.lang.IndexOutOfBoundsException : 
{code}
SELECT Count(1)
FROM   (
              SELECT `o_orderkey` ,
                     `o_custkey`
              FROM   `orders`
              UNION ALL
              SELECT `o_orderkey`,
                     0L  AS `o_custkey`
              FROM   `rcfileorders`) `oo`
WHERE  o_custkey<100000 limit 4 ;

{code}

When 
{code}
set hive.ppd.remove.duplicatefilters=true
{code}
 the fllowing query (with filter " incompatible column 'o_custkey' ")  will 
fail  with  java.lang.IndexOutOfBoundsException:
{code}   
 select count(1) from view_orders  where o_custkey<100000
{code}


> filter bug  of UNION ALL when hive.ppd.remove.duplicatefilters=true and 
> filter condition is type incompatible column 
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-11880
>                 URL: https://issues.apache.org/jira/browse/HIVE-11880
>             Project: Hive
>          Issue Type: Bug
>          Components: Logical Optimizer
>    Affects Versions: 1.2.1
>            Reporter: WangMeng
>            Assignee: WangMeng
>         Attachments: HIVE-11880.01.patch
>
>
>    For UNION ALL , when an union operator is constant column (such as '0L', 
> BIGINT Type)  and its corresponding column has incompatible type (such as INT 
> type). 
>   Query with filter condition on type incompatible column on this UNION ALL  
> will cause IndexOutOfBoundsException.
>  Such as TPC-H table "orders",in  the following query:
>  Type of 'orders'.'o_custkey' is INT normally,  while  the type of 
> corresponding constant column  "0" is BIGINT( `0L AS `o_custkey` ). 
>  This query (with filter "type incompatible column 'o_custkey' ")  will fail  
> with  java.lang.IndexOutOfBoundsException : 
> {code}
> SELECT Count(1)
> FROM   (
>               SELECT `o_orderkey` ,
>                      `o_custkey`
>               FROM   `orders`
>               UNION ALL
>               SELECT `o_orderkey`,
>                      0L  AS `o_custkey`
>               FROM   `orders`) `oo`
> WHERE  o_custkey<100000 limit 4 ;
> {code}
> When 
> {code}
> set hive.ppd.remove.duplicatefilters=true
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to