Quanlong Huang created IMPALA-13328:
---------------------------------------
Summary: Failed to build the impala_quickstart_client docker image
Key: IMPALA-13328
URL: https://issues.apache.org/jira/browse/IMPALA-13328
Project: IMPALA
Issue Type: Bug
Components: Infrastructure
Reporter: Quanlong Huang
Assignee: Quanlong Huang
Following these steps to build docker images:
https://github.com/apache/impala/blob/master/docker/README.md#publishing-quickstart-docker-images-for-developers
{code:bash}
export IMAGE_VERSION=4.4.1
./buildall.sh -noclean -notests -ninja -release
ninja docker_images quickstart_docker_images{code}
Failed in building the impala_quickstart_client image. The failure is "sh: 1:
krb5-config: not found". It seems we need to install libkrb5-dev. Full logs:
{noformat}
[3/3] Building quickstart client docker image.
FAILED: docker/CMakeFiles/quickstart_client_image
/media/quanlong/hdd-backup/impala-4.4/docker/CMakeFiles/quickstart_client_image
cd /media/quanlong/hdd-backup/impala-4.4/docker &&
/media/quanlong/hdd-backup/impala-4.4/bin/junitxml_command_wrapper.sh tar cvh .
-C /media/quanlong/hdd-backup/impala-4.4/docker/quickstart_client . |
/media/quanlong/hdd-backup/impala-4.4/docker/docker-build.sh --build-arg
BASE_IMAGE=ubuntu:18.04 --build-arg PIP=python-pip -t impala_quickstart_client -
...
./Dockerfile
#1 DONE 19.2s
#1 [internal] load remote build context
#1 DONE 19.2s
#2 copy /context /
#2 DONE 7.0s
#3 [internal] load metadata for docker.io/library/ubuntu:18.04
#3 DONE 0.0s
#4 [1/7] FROM docker.io/library/ubuntu:18.04
#4 DONE 0.0s
#5 [2/7] RUN apt-get update && apt-get install -y sudo netcat-openbsd less
curl iproute2 vim iputils-ping libsasl2-dev libsasl2-2 libsasl2-modules
libsasl2-modules-gssapi-mit tzdata krb5-user python-pip && apt-get clean &&
rm -rf /var/lib/apt/lists/*
#5 CACHED
#6 [3/7] RUN pip install impala-shell
#6 1.143 Collecting impala-shell
#6 3.767 Downloading
https://files.pythonhosted.org/packages/ce/e8/9e22b04314248b3c4177c23fd42e7a7e746b97075e81a32d385cf71d7dec/impala_shell-4.3.0.tar.gz
(483kB)
#6 4.954 Collecting bitarray==2.3.0 (from impala-shell)
#6 7.951 Downloading
https://files.pythonhosted.org/packages/92/43/4ddd1efaf5ed7913847624248f7888a55dbacab8daf07787aebf9e9a51f7/bitarray-2.3.0.tar.gz
(87kB)
#6 8.219 Collecting configparser==4.0.2 (from impala-shell)
#6 9.579 Downloading
https://files.pythonhosted.org/packages/7a/2a/95ed0501cf5d8709490b1d3a3f9b5cf340da6c433f896bbe9ce08dbe6785/configparser-4.0.2-py2.py3-none-any.whl
#6 9.626 Collecting kerberos==1.3.1 (from impala-shell)
#6 10.92 Downloading
https://files.pythonhosted.org/packages/39/cd/f98699a6e806b9d974ea1d3376b91f09edcb90415adbf31e3b56ee99ba64/kerberos-1.3.1.tar.gz
#6 11.14 Collecting prettytable==0.7.2 (from impala-shell)
#6 12.49 Downloading
https://files.pythonhosted.org/packages/ef/30/4b0746848746ed5941f052479e7c23d2b56d174b82f4fd34a25e389831f5/prettytable-0.7.2.tar.bz2
#6 12.72 Collecting sasl==0.3.1 (from impala-shell)
#6 14.13 Downloading
https://files.pythonhosted.org/packages/df/ae/d8dda9ef1636f548935c271910d3b35afbf1782df582fda88a13ea48de53/sasl-0.3.1.tar.gz
(44kB)
#6 14.37 Requirement already satisfied: setuptools>=36.8.0 in
/usr/lib/python2.7/dist-packages (from impala-shell)
#6 14.37 Collecting six==1.14.0 (from impala-shell)
#6 15.70 Downloading
https://files.pythonhosted.org/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl
#6 15.74 Collecting sqlparse==0.3.1 (from impala-shell)
#6 17.03 Downloading
https://files.pythonhosted.org/packages/85/ee/6e821932f413a5c4b76be9c5936e313e4fc626b33f16e027866e1d60f588/sqlparse-0.3.1-py2.py3-none-any.whl
(40kB)
#6 17.08 Collecting thrift==0.16.0 (from impala-shell)
#6 18.38 Downloading
https://files.pythonhosted.org/packages/e4/23/dd951c9883cb49a73b750bdfe91e39d78e8a3f1f7175608634f381a197d5/thrift-0.16.0.tar.gz
(59kB)
#6 18.64 Collecting thrift_sasl==0.4.3 (from impala-shell)
#6 19.98 Downloading
https://files.pythonhosted.org/packages/c3/9e/636c24ce1c0d46ce3020c5836c5a375d8e862fa81a240e0e352cc991dcf8/thrift_sasl-0.4.3-py2.py3-none-any.whl
#6 20.03 Collecting pure-sasl>=0.6.2 (from thrift_sasl==0.4.3->impala-shell)
#6 21.31 Downloading
https://files.pythonhosted.org/packages/37/b2/ef1124540ee2c0b417be8d0f74667957e6aa084a3f26621aa67e2e77f3fb/pure_sasl-0.6.2-py2-none-any.whl
#6 21.34 Building wheels for collected packages: impala-shell, bitarray,
kerberos, prettytable, sasl, thrift
#6 21.34 Running setup.py bdist_wheel for impala-shell: started
#6 21.79 Running setup.py bdist_wheel for impala-shell: finished with status
'done'
#6 21.79 Stored in directory:
/root/.cache/pip/wheels/70/a5/69/2a582ef04f19e2d11673320f94578ec4f381873586dddf3a87
#6 21.84 Running setup.py bdist_wheel for bitarray: started
#6 22.87 Running setup.py bdist_wheel for bitarray: finished with status
'done'
#6 22.87 Stored in directory:
/root/.cache/pip/wheels/8e/69/7c/b9277a6d3ec4e39c103f10729bf915f5688aa11e746ac6ebd4
#6 22.88 Running setup.py bdist_wheel for kerberos: started
#6 23.07 Running setup.py bdist_wheel for kerberos: finished with status
'error'
#6 23.07 Complete output from command /usr/bin/python -u -c "import
setuptools,
tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
'open', open)(__file__);code=f.read().replace('\r\n',
'\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d
/tmp/tmpWfu635pip-wheel- --python-tag cp27:
#6 23.07 /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'long_description_content_type'
#6 23.07 warnings.warn(msg)
#6 23.07 running bdist_wheel
#6 23.07 running build
#6 23.07 running build_ext
#6 23.07 building 'kerberos' extension
#6 23.07 creating build
#6 23.07 creating build/temp.linux-x86_64-2.7
#6 23.07 creating build/temp.linux-x86_64-2.7/src
#6 23.07 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
-D_FORTIFY_SOURCE=2 -g
-fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
-fstack-protector-strong -Wformat -Werror=format-security -fPIC
-I/usr/include/python2.7 -c src/base64.c -o
build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
#6 23.07 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
#6 23.07 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
#6 23.07 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or directory
#6 23.07 x86_64-linux-gnu-gcc: error: not: No such file or directory
#6 23.07 x86_64-linux-gnu-gcc: error: found: No such file or directory
#6 23.07 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
#6 23.07
#6 23.07 ----------------------------------------
#6 23.07 Failed building wheel for kerberos
#6 23.07 Running setup.py clean for kerberos
#6 23.23 Running setup.py bdist_wheel for prettytable: started
#6 23.43 Running setup.py bdist_wheel for prettytable: finished with status
'done'
#6 23.43 Stored in directory:
/root/.cache/pip/wheels/80/34/1c/3967380d9676d162cb59513bd9dc862d0584e045a162095606
#6 23.44 Running setup.py bdist_wheel for sasl: started
#6 24.64 Running setup.py bdist_wheel for sasl: finished with status 'done'
#6 24.64 Stored in directory:
/root/.cache/pip/wheels/a3/2e/2f/d341ce73b59f464dd4c03e2b833712c0392a2bed0b7502a5bb
#6 24.65 Running setup.py bdist_wheel for thrift: started
#6 26.52 Running setup.py bdist_wheel for thrift: finished with status 'done'
#6 26.52 Stored in directory:
/root/.cache/pip/wheels/70/67/9d/84bb587c0c1d15c5c225ca4572fea68a61b85c3c12918098bd
#6 26.54 Successfully built impala-shell bitarray prettytable sasl thrift
#6 26.54 Failed to build kerberos
#6 26.54 Installing collected packages: bitarray, configparser, kerberos,
prettytable, six, sasl, sqlparse, thrift, pure-sasl, thrift-sasl, impala-shell
#6 26.61 Running setup.py install for kerberos: started
#6 26.79 Running setup.py install for kerberos: finished with status 'error'
#6 26.79 Complete output from command /usr/bin/python -u -c "import
setuptools,
tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
'open', open)(__file__);code=f.read().replace('\r\n',
'\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
/tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
--compile:
#6 26.79 /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'long_description_content_type'
#6 26.79 warnings.warn(msg)
#6 26.79 running install
#6 26.79 running build
#6 26.79 running build_ext
#6 26.79 building 'kerberos' extension
#6 26.79 creating build
#6 26.79 creating build/temp.linux-x86_64-2.7
#6 26.79 creating build/temp.linux-x86_64-2.7/src
#6 26.79 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
-D_FORTIFY_SOURCE=2 -g
-fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
-fstack-protector-strong -Wformat -Werror=format-security -fPIC
-I/usr/include/python2.7 -c src/base64.c -o
build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
#6 26.79 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or
directory
#6 26.79 x86_64-linux-gnu-gcc: error: not: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: found: No such file or directory
#6 26.79 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
#6 26.79
#6 26.79 ----------------------------------------
#6 26.80 Command "/usr/bin/python -u -c "import setuptools,
tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
'open', open)(__file__);code=f.read().replace('\r\n',
'\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
/tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
--compile" failed with error code 1 in /tmp/pip-build-il1jrR/kerberos/
#6 ERROR: process "/bin/sh -c pip install impala-shell" did not complete
successfully: exit code: 1
------
> [3/7] RUN pip install impala-shell:
#6 26.79 x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -Wdate-time
-D_FORTIFY_SOURCE=2 -g
-fdebug-prefix-map=/build/python2.7-D7NSzq/python2.7-2.7.17=.
-fstack-protector-strong -Wformat -Werror=format-security -fPIC
-I/usr/include/python2.7 -c src/base64.c -o
build/temp.linux-x86_64-2.7/src/base64.o sh: 1: krb5-config: not found
#6 26.79 x86_64-linux-gnu-gcc: error: sh:: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: 1:: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: krb5-config:: No such file or
directory
#6 26.79 x86_64-linux-gnu-gcc: error: not: No such file or directory
#6 26.79 x86_64-linux-gnu-gcc: error: found: No such file or directory
#6 26.79 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
#6 26.79
#6 26.79 ----------------------------------------
#6 26.80 Command "/usr/bin/python -u -c "import setuptools,
tokenize;__file__='/tmp/pip-build-il1jrR/kerberos/setup.py';f=getattr(tokenize,
'open', open)(__file__);code=f.read().replace('\r\n',
'\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
/tmp/pip-9Wltxt-record/install-record.txt --single-version-externally-managed
--compile" failed with error code 1 in /tmp/pip-build-il1jrR/kerberos/
------
Dockerfile:45
--------------------
43 | # TODO: consider if it would be better to use the latest
impala-shell from the build
44 | # environment.
45 | >>> RUN pip install impala-shell
46 |
47 | # Use a non-privileged impala user to run the daemons in the
container.
--------------------
ERROR: failed to solve: process "/bin/sh -c pip install impala-shell" did not
complete successfully: exit code: 1
ninja: build stopped: subcommand failed.{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
