Fredy Wijaya has uploaded this change for review. ( http://gerrit.cloudera.org:8080/10748
Change subject: IMPALA-7180: Pin Impala CDH dependencies ...................................................................... IMPALA-7180: Pin Impala CDH dependencies For profile=3 Pin the CDH dependencies by storing the CDH tarballs and Maven repository in S3. This solves the issue of build coherency between between the the CDH tarballs and Maven dependencies. For profile=2 Pin the CDH dependencies by storing only the CDH tarballs in S3. The Maven repository will still use https://repositories.cloudera.com. So there is still a possibility of a build coherency issue. For each CDH dependency, there is a global build number in each repository URL to indicate the build number that created those CDH dependencies. This informaton can be useful for debugging issues related to CDH dependencies. This patch introduces CDH_HOST and CDH_BUILD_NUMBER environment variables that can be overriden, which can be useful for running an integration job. This patch also fixes dependency issue in Hadoop that transitively depends on snapshot versions of dependencies that no longer exist. See HADOOP-14903. Testing: - Ran all core tests on profile=2 and profile=3 Cherry-picks: not for 2.x Change-Id: I66c0dcb8abdd0d187490a761f129cda3b3500990 --- M bin/bootstrap_toolchain.py M bin/impala-config.sh M common/yarn-extras/pom.xml M fe/pom.xml M impala-parent/pom.xml M testdata/pom.xml M tests/test-hive-udfs/pom.xml 7 files changed, 283 insertions(+), 25 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/48/10748/2 -- To view, visit http://gerrit.cloudera.org:8080/10748 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I66c0dcb8abdd0d187490a761f129cda3b3500990 Gerrit-Change-Number: 10748 Gerrit-PatchSet: 2 Gerrit-Owner: Fredy Wijaya <[email protected]>
