[ 
https://issues.apache.org/jira/browse/DRILL-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacques Nadeau resolved DRILL-1997.
-----------------------------------
    Resolution: Not a Problem

Hive needs to tag Parquet file with UTF8 type for Drill to know.

> Hive generated parquet files with maps containing strings return wrong value
> ----------------------------------------------------------------------------
>
>                 Key: DRILL-1997
>                 URL: https://issues.apache.org/jira/browse/DRILL-1997
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Ramana Inukonda Nagaraj
>            Assignee: Parth Chandra
>            Priority: Critical
>         Attachments: hive_alltypes.parquet
>
>
> Created a parquet file in hive having the following DDL
> hive> desc alltypesparquet;          
> OK
> c1                    int                                         
> c2                    boolean                                     
> c3                    double                                      
> c4                    string                                      
> c5                    array<int>                                  
> c6                    map<int,string>                             
> c7                    map<string,string>                          
> c8                    struct<r:string,s:int,t:double>                     
> c9                    tinyint                                     
> c10                   smallint                                    
> c11                   float                                       
> c12                   bigint                                      
> c13                   array<array<string>>                        
> c15                   struct<r:int,s:struct<a:int,b:string>>                  
>     
> c16                   array<struct<m:map<string,string>,n:int>>               
>             
> Time taken: 0.076 seconds, Fetched: 15 row(s)
> All the complex types with string in them are returning incorrect values in 
> drill. For example:
> hive> select c6 from alltypesparquet;
> NULL
> NULL
> {1:"x",2:"y"}
> 0: jdbc:drill:> select c6 from `/user/hive/warehouse/alltypesparquet`;
> +------------+
> |     c6     |
> +------------+
> | {"map":[]} |
> | {"map":[]} |
> | {"map":[{"key":1,"value":"eA=="},{"key":2,"value":"eQ=="}]} |
> +------------+
> 3 rows selected (0.077 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to