Taras Bobrovytsky has submitted this change and it was merged. Change subject: IMPALA-3778: Fix ASF packaging build ......................................................................
IMPALA-3778: Fix ASF packaging build The tarballs in IMPALA_HOME/infra/python/deps and the thirdparty directory have been removed in the ASF repository. All Python dependencies and CDH components must now be downloaded as part of every build. This caused the ASF packaging build to fail. Before this patch, we used the system pip to download the Python dependencies, which caused flakiness and inconsistency on different operating systems. This patch fixes the problem by using our own script (which requires Python 2.6+ to be installed on the system), to download all the files in requirements.txt. Also replaced all whl and zip Python packages with tar.gz to make it consistent with the ASF build. Change-Id: Ibe5a743096cda2059bd330805d324983f6730e19 Reviewed-on: http://gerrit.cloudera.org:8080/3647 Reviewed-by: Jim Apple <[email protected]> Tested-by: Taras Bobrovytsky <[email protected]> --- M bin/impala-config.sh D infra/python/deps/Fabric-1.10.2-py2-none-any.whl A infra/python/deps/Fabric-1.10.2.tar.gz D infra/python/deps/Jinja2-2.8-py2.py3-none-any.whl A infra/python/deps/Jinja2-2.8.tar.gz D infra/python/deps/Werkzeug-0.11.3-py2.py3-none-any.whl A infra/python/deps/Werkzeug-0.11.3.tar.gz D infra/python/deps/apipkg-1.4-py2.py3-none-any.whl A infra/python/deps/apipkg-1.4.tar.gz D infra/python/deps/argparse-1.4.0-py2.py3-none-any.whl A infra/python/deps/argparse-1.4.0.tar.gz D infra/python/deps/boto3-1.2.3-py2.py3-none-any.whl A infra/python/deps/boto3-1.2.3.tar.gz D infra/python/deps/botocore-1.3.30-py2.py3-none-any.whl A infra/python/deps/botocore-1.3.30.tar.gz M infra/python/deps/download_requirements D infra/python/deps/ecdsa-0.13-py2.py3-none-any.whl A infra/python/deps/ecdsa-0.13.tar.gz D infra/python/deps/execnet-1.4.0-py2.py3-none-any.whl A infra/python/deps/execnet-1.4.0.tar.gz A infra/python/deps/find_py26.py D infra/python/deps/futures-3.0.5-py2-none-any.whl A infra/python/deps/futures-3.0.5.tar.gz D infra/python/deps/jmespath-0.9.0-py2.py3-none-any.whl A infra/python/deps/jmespath-0.9.0.tar.gz D infra/python/deps/linecache2-1.0.0-py2.py3-none-any.whl A infra/python/deps/linecache2-1.0.0.tar.gz D infra/python/deps/paramiko-1.15.2-py2.py3-none-any.whl A infra/python/deps/paramiko-1.15.2.tar.gz D infra/python/deps/pbr-1.8.1-py2.py3-none-any.whl A infra/python/deps/pbr-1.8.1.tar.gz D infra/python/deps/pg8000-1.10.2-py2.py3-none-any.whl A infra/python/deps/pg8000-1.10.2.tar.gz M infra/python/deps/pip_download.py D infra/python/deps/py-1.4.30-py2.py3-none-any.whl A infra/python/deps/py-1.4.30.tar.gz D infra/python/deps/pyparsing-2.0.3-py2.py3-none-any.whl A infra/python/deps/pyparsing-2.0.3.tar.gz D infra/python/deps/pytest-2.7.2-py2.py3-none-any.whl A infra/python/deps/pytest-2.7.2.tar.gz A infra/python/deps/python-dateutil-2.5.2.tar.gz D infra/python/deps/python_dateutil-2.5.2-py2.py3-none-any.whl D infra/python/deps/requests-2.7.0-py2.py3-none-any.whl A infra/python/deps/requests-2.7.0.tar.gz M infra/python/deps/requirements.txt D infra/python/deps/six-1.9.0-py2.py3-none-any.whl A infra/python/deps/six-1.9.0.tar.gz A infra/python/deps/texttable-0.8.3.zip D infra/python/deps/texttable-v0.8.3.tar.gz D infra/python/deps/traceback2-1.4.0-py2.py3-none-any.whl A infra/python/deps/traceback2-1.4.0.tar.gz D infra/python/deps/unittest2-1.1.0-py2.py3-none-any.whl A infra/python/deps/unittest2-1.1.0.tar.gz 53 files changed, 169 insertions(+), 72 deletions(-) Approvals: Taras Bobrovytsky: Verified Jim Apple: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/3647 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ibe5a743096cda2059bd330805d324983f6730e19 Gerrit-PatchSet: 3 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Taras Bobrovytsky <[email protected]> Gerrit-Reviewer: Jim Apple <[email protected]> Gerrit-Reviewer: Taras Bobrovytsky <[email protected]>
