Hello Vihang Karajgaonkar, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/13872
to look at the new patch set (#4).
Change subject: IMPALA-8766: Change cloud dependencies to use
hadoop-cloud-storage
......................................................................
IMPALA-8766: Change cloud dependencies to use hadoop-cloud-storage
Currently, fe/pom.xml includes direct dependencies on hadoop-aws,
hadoop-azure, and hadoop-azure-datalake. Hadoop has a meta-package
hadoop-cloud-storage that provides these dependencies with appropriate
exclusions. This would not change Impala's build significantly, but
it allows different versions or distributions of Hadoop to add
necessary runtime jars to the classpath. For example, distributions
of Hadoop that use Apache Knox for identity management can add
Knox jars to this meta-package.
This switches Impala to use the hadoop-cloud-storage package. This
does not change the default configuration, but the USE_CDP_HIVE=true
configuration gains Apache Knox jars.
Due to the structure of the CDP maven repository, it has dependencies
on versions of jars that are not in the CDP maven repository. So,
USE_CDP_HIVE=true requires the Hortonworks public maven repository.
This is added, but it is only enabled with USE_CDP_HIVE=true and only
for releases (no SNAPSHOTs).
Testing:
- Ran core tests
- Manually verified classpath changes
Change-Id: I08f1c36ecf54ac277d99e2d2843163eada732e50
---
M fe/pom.xml
M impala-parent/pom.xml
2 files changed, 29 insertions(+), 14 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/13872/4
--
To view, visit http://gerrit.cloudera.org:8080/13872
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I08f1c36ecf54ac277d99e2d2843163eada732e50
Gerrit-Change-Number: 13872
Gerrit-PatchSet: 4
Gerrit-Owner: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
