[
https://issues.apache.org/jira/browse/IMPALA-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang resolved IMPALA-13328.
-------------------------------------
Fix Version/s: Impala 4.5.0
Resolution: Fixed
> Failed to build the impala_quickstart_client docker image
> ---------------------------------------------------------
>
> Key: IMPALA-13328
> URL: https://issues.apache.org/jira/browse/IMPALA-13328
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
> Fix For: Impala 4.5.0
>
>
> Following these steps to build docker images:
> https://github.com/apache/impala/blob/master/docker/README.md#publishing-quickstart-docker-images-for-developers
> {code:bash}
> export IMAGE_VERSION=4.4.1
> ./buildall.sh -noclean -notests -ninja -release
> ninja docker_images quickstart_docker_images{code}
> Failed in building the impala_quickstart_client image. The failure is "sh: 1:
> krb5-config: not found". It seems we need to install libkrb5-dev. Full logs:
> {noformat}
> [3/3] Building quickstart client docker image.
> FAILED: docker/CMakeFiles/quickstart_client_image
> /media/quanlong/hdd-backup/impala-4.4/docker/CMakeFiles/quickstart_client_image
>
> cd /media/quanlong/hdd-backup/impala-4.4/docker &&
> /media/quanlong/hdd-backup/impala-4.4/bin/junitxml_command_wrapper.sh tar cvh
> . -C /media/quanlong/hdd-backup/impala-4.4/docker/quickstart_client . |
> /media/quanlong/hdd-backup/impala-4.4/docker/docker-build.sh --build-arg
> BASE_IMAGE=ubuntu:18.04 --build-arg PIP=python-pip -t
> impala_quickstart_client -
> ...
> ./Dockerfile
> #1 DONE 19.2s
> #1 [internal] load remote build context
> #1 DONE 19.2s
> #2 copy /context /
> #2 DONE 7.0s
> #3 [internal] load metadata for docker.io/library/ubuntu:18.04
> #3 DONE 0.0s
> #4 [1/7] FROM docker.io/library/ubuntu:18.04
> #4 DONE 0.0s
> #5 [2/7] RUN apt-get update && apt-get install -y sudo netcat-openbsd
> less curl iproute2 vim iputils-ping libsasl2-dev libsasl2-2
> libsasl2-modules libsasl2-modules-gssapi-mit tzdata krb5-user python-pip &&
> apt-get clean && rm -rf /var/lib/apt/lists/*
> #5 CACHED
> #6 [3/7] RUN pip install impala-shell
> #6 1.143 Collecting impala-shell
> #6 3.767 Downloading
> https://files.pythonhosted.org/packages/ce/e8/9e22b04314248b3c4177c23fd42e7a7e746b97075e81a32d385cf71d7dec/impala_shell-4.3.0.tar.gz
> (483kB)
> #6 4.954 Collecting bitarray==2.3.0 (from impala-shell)
> #6 7.951 Downloading
> https://files.pythonhosted.org/packages/92/43/4ddd1efaf5ed7913847624248f7888a55dbacab8daf07787aebf9e9a51f7/bitarray-2.3.0.tar.gz
> (87kB)
> #6 8.219 Collecting configparser==4.0.2 (from impala-shell)
> #6 9.579 Downloading
> https://files.pythonhosted.org/packages/7a/2a/95ed0501cf5d8709490b1d3a3f9b5cf340da6c433f896bbe9ce08dbe6785/configparser-4.0.2-py2.py3-none-any.whl
> #6 9.626 Collecting kerberos==1.3.1 (from impala-shell)
> #6 10.92 Downloading
> https://files.pythonhosted.org/packages/39/cd/f98699a6e806b9d974ea1d3376b91f09edcb90415adbf31e3b56ee99ba64/kerberos-1.3.1.tar.gz
> #6 11.14 Collecting prettytable==0.7.2 (from impala-shell)
> #6 12.49 Downloading
> https://files.pythonhosted.org/packages/ef/30/4b0746848746ed5941f052479e7c23d2b56d174b82f4fd34a25e389831f5/prettytable-0.7.2.tar.bz2
> #6 12.72 Collecting sasl==0.3.1 (from impala-shell)
> #6 14.13 Downloading
> https://files.pythonhosted.org/packages/df/ae/d8dda9ef1636f548935c271910d3b35afbf1782df582fda88a13ea48de53/sasl-0.3.1.tar.gz
> (44kB)
> #6 14.37 Requirement already satisfied: setuptools>=36.8.0 in
> /usr/lib/python2.7/dist-packages (from impala-shell)
> #6 14.37 Collecting six==1.14.0 (from impala-shell)
> #6 15.70 Downloading
> https://files.pythonhosted.org/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl
> #6 15.74 Collecting sqlparse==0.3.1 (from impala-shell)
> #6 17.03 Downloading
> https://files.pythonhosted.org/packages/85/ee/6e821932f413a5c4b76be9c5936e313e4fc626b33f16e027866e1d60f588/sqlparse-0.3.1-py2.py3-none-any.whl
> (40kB)
> #6 17.08 Collecting thrift==0.16.0 (from impala-shell)
> #6 18.38 Downloading
> https://files.pythonhosted.org/packages/e4/23/dd951c9883cb49a73b750bdfe91e39d78e8a3f1f7175608634f381a197d5/thrift-0.16.0.tar.gz
> (59kB)
> #6 18.64 Collecting thrift_sasl==0.4.3 (from impala-shell)
> #6 19.98 Downloading
> https://files.pythonhosted.org/packages/c3/9e/636c24ce1c0d46ce3020c5836c5a375d8e862fa81a240e0e352cc991dcf8/thrift_sasl-0.4.3-py2.py3-none-any.whl
> #6 20.03 Collecting pure-sasl>=0.6.2 (from thrift_sasl==0.4.3->impala-shell)
> #6 21.31 Downloading
> https://files.pythonhosted.org/packages/37/b2/ef1124540ee2c0b417be8d0f74667957e6aa084a3f26621aa67e2e77f3fb/pure_sasl-0.6.2-py2-none-any.whl
> #6 21.34 Building wheels for collected packages: impala-shell, bitarray,
> kerberos, prettytable, sasl, thrift
> #6 21.34 Running setup.py bdist_wheel for impala-shell: started
> #6 21.79 Running setup.py bdist_wheel for impala-shell: finished with
> status 'done'
> #6 21.79 Stored in directory:
> /root/.cache/pip/wheels/70/a5/69/2a582ef04f19e2d11673320f94578ec4f381873586dddf3a87
> #6 21.84 Running setup.py bdist_wheel for bitarray: started
> #6 22.87 Running setup.py bdist_wheel for bitarray: finished with status
> 'done'
> #6 22.87 Stored in directory:
> /root/.cache/pip/wheels/8e/69/7c/b9277a6d3ec4e39c103f10729bf915f5688aa11e746ac6ebd4
> #6 22.88 Running setup.py bdist_wheel for kerberos: started
> #6 23.07 Running setup.py bdist_wheel for kerberos: finished with status
> 'error'
> #6 23.07 Complete output from command /usr/bin/python -u -c "import
> setuptools,
> tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
> 'open', open)(__file__);code=f.read().replace('\r\n',
> '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d
> /tmp/tmpWfu635pip-wheel- --python-tag cp27:
> #6 23.07 /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
> distribution option: 'long_description_content_type'
> #6 23.07 warnings.warn(msg)
> #6 23.07 running bdist_wheel
> #6 23.07 running build
> #6 23.07 running build_ext
> #6 23.07 building 'kerberos' extension
> #6 23.07 creating build
> #6 23.07 creating build/temp.linux-x86_64-2.7
> #6 23.07 creating build/temp.linux-x86_64-2.7/src
> #6 23.07 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
> -D_FORTIFY_SOURCE=2 -g
> -fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
> -fstack-protector-strong -Wformat -Werror=format-security -fPIC
> -I/usr/include/python2.7 -c src/base64.c -o
> build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
> #6 23.07 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
> #6 23.07 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
> #6 23.07 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or
> directory
> #6 23.07 x86_64-linux-gnu-gcc: error: not: No such file or directory
> #6 23.07 x86_64-linux-gnu-gcc: error: found: No such file or directory
> #6 23.07 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
> #6 23.07
> #6 23.07 ----------------------------------------
> #6 23.07 Failed building wheel for kerberos
> #6 23.07 Running setup.py clean for kerberos
> #6 23.23 Running setup.py bdist_wheel for prettytable: started
> #6 23.43 Running setup.py bdist_wheel for prettytable: finished with status
> 'done'
> #6 23.43 Stored in directory:
> /root/.cache/pip/wheels/80/34/1c/3967380d9676d162cb59513bd9dc862d0584e045a162095606
> #6 23.44 Running setup.py bdist_wheel for sasl: started
> #6 24.64 Running setup.py bdist_wheel for sasl: finished with status 'done'
> #6 24.64 Stored in directory:
> /root/.cache/pip/wheels/a3/2e/2f/d341ce73b59f464dd4c03e2b833712c0392a2bed0b7502a5bb
> #6 24.65 Running setup.py bdist_wheel for thrift: started
> #6 26.52 Running setup.py bdist_wheel for thrift: finished with status
> 'done'
> #6 26.52 Stored in directory:
> /root/.cache/pip/wheels/70/67/9d/84bb587c0c1d15c5c225ca4572fea68a61b85c3c12918098bd
> #6 26.54 Successfully built impala-shell bitarray prettytable sasl thrift
> #6 26.54 Failed to build kerberos
> #6 26.54 Installing collected packages: bitarray, configparser, kerberos,
> prettytable, six, sasl, sqlparse, thrift, pure-sasl, thrift-sasl, impala-shell
> #6 26.61 Running setup.py install for kerberos: started
> #6 26.79 Running setup.py install for kerberos: finished with status
> 'error'
> #6 26.79 Complete output from command /usr/bin/python -u -c "import
> setuptools,
> tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
> 'open', open)(__file__);code=f.read().replace('\r\n',
> '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
> /tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
> --compile:
> #6 26.79 /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
> distribution option: 'long_description_content_type'
> #6 26.79 warnings.warn(msg)
> #6 26.79 running install
> #6 26.79 running build
> #6 26.79 running build_ext
> #6 26.79 building 'kerberos' extension
> #6 26.79 creating build
> #6 26.79 creating build/temp.linux-x86_64-2.7
> #6 26.79 creating build/temp.linux-x86_64-2.7/src
> #6 26.79 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
> -D_FORTIFY_SOURCE=2 -g
> -fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
> -fstack-protector-strong -Wformat -Werror=format-security -fPIC
> -I/usr/include/python2.7 -c src/base64.c -o
> build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
> #6 26.79 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or
> directory
> #6 26.79 x86_64-linux-gnu-gcc: error: not: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: found: No such file or directory
> #6 26.79 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
> #6 26.79
> #6 26.79 ----------------------------------------
> #6 26.80 Command "/usr/bin/python -u -c "import setuptools,
> tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
> 'open', open)(__file__);code=f.read().replace('\r\n',
> '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
> /tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
> --compile" failed with error code 1 in /tmp/pip-build-il1jrR/kerberos/
> #6 ERROR: process "/bin/sh -c pip install impala-shell" did not complete
> successfully: exit code: 1
> ------
> > [3/7] RUN pip install impala-shell:
> #6 26.79 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
> -D_FORTIFY_SOURCE=2 -g
> -fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
> -fstack-protector-strong -Wformat -Werror=format-security -fPIC
> -I/usr/include/python2.7 -c src/base64.c -o
> build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
> #6 26.79 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or
> directory
> #6 26.79 x86_64-linux-gnu-gcc: error: not: No such file or directory
> #6 26.79 x86_64-linux-gnu-gcc: error: found: No such file or directory
> #6 26.79 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
> #6 26.79
> #6 26.79 ----------------------------------------
> #6 26.80 Command "/usr/bin/python -u -c "import setuptools,
> tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
> 'open', open)(__file__);code=f.read().replace('\r\n',
> '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
> /tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
> --compile" failed with error code 1 in /tmp/pip-build-il1jrR/kerberos/
> ------
> Dockerfile:45
> --------------------
> 43 | # TODO: consider if it would be better to use the latest
> impala-shell from the build
> 44 | # environment.
> 45 | >>> RUN pip install impala-shell
> 46 |
> 47 | # Use a non-privileged impala user to run the daemons in the
> container.
> --------------------
> ERROR: failed to solve: process "/bin/sh -c pip install impala-shell" did not
> complete successfully: exit code: 1
> ninja: build stopped: subcommand failed.{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
