Joe McDonnell created IMPALA-8766:
-------------------------------------

             Summary: Change hadoop cloud dependencies to use 
hadoop-cloud-storage
                 Key: IMPALA-8766
                 URL: https://issues.apache.org/jira/browse/IMPALA-8766
             Project: IMPALA
          Issue Type: Improvement
          Components: Infrastructure
    Affects Versions: Impala 3.3.0
            Reporter: Joe McDonnell
            Assignee: Joe McDonnell


Currently, fe/pom.xml specifically includes hadoop-aws, hadoop-azure, and 
hadoop-azure-datalake directly. There is a meta-package in hadoop called 
hadoop-cloud-storage that includes these dependencies and others as customized 
by the hadoop provider, with appropriate exclusions applied to each package.

Migrating Impala to use this meta-package would make it easier for different 
providers of hadoop to customize hadoop-cloud-storage and the resulting 
CLASSPATH without needing to change Impala. For example, a hadoop provider may 
want to include Apache Knox for cloud identity management.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to