Grant Henke created IMPALA-8629:
-----------------------------------

             Summary: Adjust new KuduStorageHandler package
                 Key: IMPALA-8629
                 URL: https://issues.apache.org/jira/browse/IMPALA-8629
             Project: IMPALA
          Issue Type: Sub-task
          Components: Catalog, Frontend
            Reporter: Grant Henke


Before releasing with the updated KuduStorageHandler, we should change the new 
KuduStorageHandler package from “org.apache.kudu.hive” to 
“org.apache.hadoop.hive.kudu”.

 

This should being done to ensure the stand-in storage handler can be a real 
storage handler when a Hive integration is added in the future. The 
“org.apache.hadoop.hive” package is the standard package all Hive storage 
handlers lives under.

 

Additionally the stand-in format details defined 
[here|https://github.com/apache/impala/blob/2bce974990e19788ec359deec50f06d44ec92048/fe/src/main/java/org/apache/impala/catalog/HdfsFileFormat.java#L70]
 should be updated as well. Values for those entries should be:
{noformat}
org.apache.hadoop.hive.kudu.KuduInputFormat 
org.apache.hadoop.hive.kudu.KuduOutputFormat 
org.apache.hadoop.hive.kudu.KuduSerDe 
{noformat}
 

I have a WIP patch for HIVE-12971 and used that patch to validate that using 
"correct" stand-in values would allow Hive to read HMS tables/entries created 
by Impala. 

 

Note: This patch will need to be committed after the Kudu side patch is 
committed and the Kudu build/version may need to be update in Impala. A review 
for the Kudu side change is here: [https://gerrit.cloudera.org/#/c/13540/]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to