Impala Public Jenkins has submitted this change and it was merged. (
http://gerrit.cloudera.org:8080/9860 )
Change subject: IMPALA-6769: Avoid pulling incoherent Hadoop dependencies.
......................................................................
IMPALA-6769: Avoid pulling incoherent Hadoop dependencies.
Through the following chain of dependencies, Impala was pulling in a
second copy of hadoop-client, mismatched with $IMPALA_HADOOP_VERSION.
To avoid this, we can blacklist the unnecessary dependency on
hive-llap-server, which we don't use.
To prevent this sort of thing from recurring, I used Maven's
"banned dependency plugin" to blacklist
org.apache.{hadoop,hive,kudu,sentry,hbase,parquet} and whitelist the
versions we expect. I confirmed that "mvn compile" would fail
if the new exclusion I added here wasn't present.
This is the relevant snippet of "mvn dependency:tree" showing how we
were pulling this in:
[INFO] +- org.apache.hive:hive-service:jar:2.1.1-cdh6.x-SNAPSHOT:compile
[INFO] | +-
org.apache.hive:hive-service-rpc:jar:2.1.1-cdh6.x-SNAPSHOT:compile
[INFO] | +-
org.apache.hive:hive-llap-server:jar:2.1.1-cdh6.x-SNAPSHOT:compile
[INFO] | | \- org.apache.slider:slider-core:jar:0.90.2-incubating:compile
[INFO] | | +- org.apache.hadoop:hadoop-client:jar:2.7.1:compile
Change-Id: Ie4b38c4fc5e30ec1464586282f08e3b82f30d7bd
Reviewed-on: http://gerrit.cloudera.org:8080/9860
Reviewed-by: Philip Zeyliger <[email protected]>
Tested-by: Impala Public Jenkins
---
M fe/pom.xml
1 file changed, 26 insertions(+), 0 deletions(-)
Approvals:
Philip Zeyliger: Looks good to me, approved
Impala Public Jenkins: Verified
--
To view, visit http://gerrit.cloudera.org:8080/9860
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: Ie4b38c4fc5e30ec1464586282f08e3b82f30d7bd
Gerrit-Change-Number: 9860
Gerrit-PatchSet: 3
Gerrit-Owner: Philip Zeyliger <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Philip Zeyliger <[email protected]>