Michael Smith has posted comments on this change. ( http://gerrit.cloudera.org:8080/18668 )
Change subject: IMPALA-11399: Download shell dependencies from PyPI ...................................................................... Patch Set 7: (3 comments) http://gerrit.cloudera.org:8080/#/c/18668/7/infra/python/deps/download_requirements File infra/python/deps/download_requirements: http://gerrit.cloudera.org:8080/#/c/18668/7/infra/python/deps/download_requirements@27 PS7, Line 27: *requirements.txt > Nit: I'm conflicted about having a wildcard vs just listing the specific re Ok, that's easy enough to add back. http://gerrit.cloudera.org:8080/#/c/18668/7/shell/make_shell_tarball.sh File shell/make_shell_tarball.sh: http://gerrit.cloudera.org:8080/#/c/18668/7/shell/make_shell_tarball.sh@107 PS7, Line 107: rm -rf ${SHELL_HOME}/ext-py && mkdir -p ${SHELL_HOME}/ext-py : for line in $(cat ${SHELL_HOME}/packaging/requirements.txt); do : package=${line%==*} : version=${line#*==} : module=${SHELL_HOME}/packaging/${package}-${version} : echo "Extracting ${module}" : if [ -f ${module}.tar.gz ]; then : tar xzf ${module}.tar.gz -C ${SHELL_HOME}/ext-py : else : tar xjf ${module}.tar.bz2 -C ${SHELL_HOME}/ext-py > I'm concerned about putting the the unpacked tarball files in ${IMPALA_HOME That makes some sense, although it shouldn't really happen because specific versions should be fixed artifacts. I can unpack them to build/ instead. http://gerrit.cloudera.org:8080/#/c/18668/7/shell/packaging/requirements.txt File shell/packaging/requirements.txt: http://gerrit.cloudera.org:8080/#/c/18668/7/shell/packaging/requirements.txt@8 PS7, Line 8: thrift_sasl==0.4.3 > One complication is that we patched thrift_sasl to allow things to build on We've updated CentOS environments recently. This is primarily a build-time issue, so if it passes the private parameterized build it might be fine. -- To view, visit http://gerrit.cloudera.org:8080/18668 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3b76e112ba9d0db19fae3e8eb15fd54a721f80fd Gerrit-Change-Number: 18668 Gerrit-PatchSet: 7 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]> Gerrit-Comment-Date: Thu, 14 Jul 2022 16:15:29 +0000 Gerrit-HasComments: Yes
