[
https://issues.apache.org/jira/browse/KUDU-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764106#comment-17764106
]
Yingchun Lai edited comment on KUDU-3510 at 9/12/23 9:52 AM:
-------------------------------------------------------------
The issue #2 seems can be resolved by command:
{code:java}
docker run --privileged multiarch/qemu-user-static:latest --reset -p yes
--credential yes {code}
ref: [https://github.com/docker/buildx/issues/1335]
It works well after the command.
{code:java}
$ python3 ./docker/docker-build.py --action load --platforms linux/amd64
Starting docker build: 2023-09-12T17:35:26.209468
Version: 1.17.0 (a3cd1ef13)
Bases: ['ubuntu:bionic']
Targets: ['kudu', 'kudu-python']
Building targets for ubuntu:bionic...
Building kudu target...
Running: docker buildx build --load --platform linux/amd64 --build-arg
RUNTIME_BASE_OS="ubuntu:bionic" --build-arg DEV_BASE_OS="ubuntu:bionic"
--build-arg BASE_OS="ubuntu:bionic" --build-arg DOCKERFILE="docker/Dockerfile"
--build-arg MAINTAINER="Apache Kudu <[email protected]>" --build-arg
URL="https://kudu.apache.org"; --build-arg VERSION="1.17.0" --build-arg
VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git" --build-arg
VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu --tag
apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag apache/kudu:latest-ubuntu
--tag apache/kudu:latest /data/qdev/laiyingchun/kudu
[+] Building 11.8s (52/52) FINISHED
...
Finished Docker build: 2023-09-12T17:37:37.680546 (0:02:11.471078) {code}
{code:java}
$ python3 ./docker/docker-build.py --action load --platforms linux/arm64
Starting docker build: 2023-09-12T17:41:29.525245 Version: 1.17.0 (a3cd1ef13)
Bases: ['ubuntu:bionic'] Targets: ['kudu', 'kudu-python'] Building targets for
ubuntu:bionic... Building kudu target... Running: docker buildx build --load
--platform linux/arm64 --build-arg RUNTIME_BASE_OS="ubuntu:bionic" --build-arg
DEV_BASE_OS="ubuntu:bionic" --build-arg BASE_OS="ubuntu:bionic" --build-arg
DOCKERFILE="docker/Dockerfile" --build-arg MAINTAINER="Apache Kudu
<[email protected]>" --build-arg URL="https://kudu.apache.org"; --build-arg
VERSION="1.17.0" --build-arg VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git"
--build-arg VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu --tag
apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag apache/kudu:latest-ubuntu
--tag apache/kudu:latest /data/qdev/laiyingchun/kudu [+] Building 21.5s (52/52)
FINISHED => [internal] load .dockerignore
0.0s ...
Building kudu-python target...
Running: docker buildx build --load --platform linux/arm64 --build-arg
RUNTIME_BASE_OS="ubuntu:bionic" --build-arg DEV_BASE_OS="ubuntu:bionic"
--build-arg BASE_OS="ubuntu:bionic" --build-arg DOCKERFILE="docker/Dockerfile"
--build-arg MAINTAINER="Apache Kudu <[email protected]>" --build-arg
URL="https://kudu.apache.org"; --build-arg VERSION="1.17.0" --build-arg
VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git" --build-arg
VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu-python --tag
apache/kudu:kudu-python-1.17.0-ubuntu --tag apache/kudu:kudu-python-1.17.0
--tag apache/kudu:kudu-python-1.17-ubuntu --tag apache/kudu:kudu-python-1.17
--tag apache/kudu:kudu-python-latest-ubuntu --tag
apache/kudu:kudu-python-latest /data/qdev/laiyingchun/kudu
[+] Building 407.2s (53/53) FINISHED
...
Finished Docker build: 2023-09-12T17:48:39.189521 (0:07:09.664276)
{code}
was (Author: laiyingchun):
The issue #2 seems can be resolved by command:
{code:java}
docker run --privileged multiarch/qemu-user-static:latest --reset -p yes
--credential yes {code}
ref: [https://github.com/docker/buildx/issues/1335]
It works well after the command.
{code:java}
$ python3 ./docker/docker-build.py --action load --platforms linux/amd64
Starting docker build: 2023-09-12T17:35:26.209468
Version: 1.17.0 (a3cd1ef13)
Bases: ['ubuntu:bionic']
Targets: ['kudu', 'kudu-python']
Building targets for ubuntu:bionic...
Building kudu target...
Running: docker buildx build --load --platform linux/amd64 --build-arg
RUNTIME_BASE_OS="ubuntu:bionic" --build-arg DEV_BASE_OS="ubuntu:bionic"
--build-arg BASE_OS="ubuntu:bionic" --build-arg DOCKERFILE="docker/Dockerfile"
--build-arg MAINTAINER="Apache Kudu <[email protected]>" --build-arg
URL="https://kudu.apache.org"; --build-arg VERSION="1.17.0" --build-arg
VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git" --build-arg
VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu --tag
apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag apache/kudu:latest-ubuntu
--tag apache/kudu:latest /data/qdev/laiyingchun/kudu
[+] Building 11.8s (52/52) FINISHED
...
Finished Docker build: 2023-09-12T17:37:37.680546 (0:02:11.471078) {code}
{code:java}
$ python3 ./docker/docker-build.py --action load --platforms linux/arm64
Starting docker build: 2023-09-12T17:41:29.525245 Version: 1.17.0 (a3cd1ef13)
Bases: ['ubuntu:bionic'] Targets: ['kudu', 'kudu-python'] Building targets for
ubuntu:bionic... Building kudu target... Running: docker buildx build --load
--platform linux/arm64 --build-arg RUNTIME_BASE_OS="ubuntu:bionic" --build-arg
DEV_BASE_OS="ubuntu:bionic" --build-arg BASE_OS="ubuntu:bionic" --build-arg
DOCKERFILE="docker/Dockerfile" --build-arg MAINTAINER="Apache Kudu
<[email protected]>" --build-arg URL="https://kudu.apache.org"; --build-arg
VERSION="1.17.0" --build-arg VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git"
--build-arg VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu --tag
apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag apache/kudu:latest-ubuntu
--tag apache/kudu:latest /data/qdev/laiyingchun/kudu [+] Building 21.5s (52/52)
FINISHED => [internal] load .dockerignore
0.0s ...
Building kudu-python target...
Running: docker buildx build --load --platform linux/arm64 --build-arg
RUNTIME_BASE_OS="ubuntu:bionic" --build-arg DEV_BASE_OS="ubuntu:bionic"
--build-arg BASE_OS="ubuntu:bionic" --build-arg DOCKERFILE="docker/Dockerfile"
--build-arg MAINTAINER="Apache Kudu <[email protected]>" --build-arg
URL="https://kudu.apache.org"; --build-arg VERSION="1.17.0" --build-arg
VCS_REF="a3cd1ef13" --build-arg VCS_TYPE="git" --build-arg
VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
/data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu-python --tag
apache/kudu:kudu-python-1.17.0-ubuntu --tag apache/kudu:kudu-python-1.17.0
--tag apache/kudu:kudu-python-1.17-ubuntu --tag apache/kudu:kudu-python-1.17
--tag apache/kudu:kudu-python-latest-ubuntu --tag
apache/kudu:kudu-python-latest /data/qdev/laiyingchun/kudu
[+] Building 407.2s (53/53) FINISHED
Finished Docker build: 2023-09-12T17:48:39.189521 (0:07:09.664276)
{code}
> Docker images build failed
> --------------------------
>
> Key: KUDU-3510
> URL: https://issues.apache.org/jira/browse/KUDU-3510
> Project: Kudu
> Issue Type: Bug
> Components: build, docker
> Affects Versions: 1.17.0
> Reporter: Yingchun Lai
> Priority: Major
>
> I encountered some issures when try to build Docker images:
> 1.
> Enviroment:
> CentOS 7.9, docker 24.0.1.
> Error:
> {code:java}
> $ python ./docker/docker-build.py --action push --platforms linux/amd64
> linux/arm64
> Starting docker build: 2023-09-12T13:43:53.888588
> Version: 1.17.0 (a3cd1ef13)
> ...
> => CANCELED [linux/amd64 dev 7/7] RUN ./bootstrap-dev-env.sh &&
> ./bootstrap-java-env.sh && ./bootstrap-python-env.sh && rm
> bootstrap-dev-env.sh && rm bootstrap-java-env.sh && rm
> bootstrap-python-env.sh 2.7s
> => ERROR [linux/arm64 dev 7/7] RUN ./bootstrap-dev-env.sh &&
> ./bootstrap-java-env.sh && ./bootstrap-python-env.sh && rm
> bootstrap-dev-env.sh && rm bootstrap-java-env.sh && rm
> bootstrap-python-env.sh 2.0s
> => CANCELED [linux/arm64 runtime 5/5] RUN ./bootstrap-runtime-env.sh && rm
> bootstrap-runtime-env.sh
>
> 2.4s
> ------
> > [linux/arm64 dev 7/7] RUN ./bootstrap-dev-env.sh &&
> ./bootstrap-java-env.sh && ./bootstrap-python-env.sh && rm
> bootstrap-dev-env.sh && rm bootstrap-java-env.sh && rm
> bootstrap-python-env.sh:
> #0 1.451 Error while loading ȇs//./bootstrap-dev-env.sh: No such file or
> directory
> ------
> ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/sh -c
> ./bootstrap-dev-env.sh && ./bootstrap-java-env.sh &&
> ./bootstrap-python-env.sh && rm bootstrap-dev-env.sh && rm
> bootstrap-java-env.sh && rm bootstrap-python-env.sh" did not complete
> successfully: exit code: 1
> Traceback (most recent call last):
> File "./docker/docker-build.py", line 384, in <module>
> main()
> File "./docker/docker-build.py", line 377, in main
> run_command(docker_build_cmd, opts)
> File "./docker/docker-build.py", line 145, in run_command
> subprocess.check_output(cmd, shell=True)
> File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
> raise CalledProcessError(retcode, cmd, output=output)
> subprocess.CalledProcessError: Command 'docker buildx build --push --platform
> linux/arm64,linux/amd64 --build-arg RUNTIME_BASE_OS="ubuntu:bionic"
> --build-arg DEV_BASE_OS="ubuntu:bionic" --build-arg BASE_OS="ubuntu:bionic"
> --build-arg DOCKERFILE="docker/Dockerfile" --build-arg MAINTAINER="Apache
> Kudu <[email protected]>" --build-arg URL="https://kudu.apache.org";
> --build-arg VERSION="1.17.0" --build-arg VCS_REF="a3cd1ef13" --build-arg
> VCS_TYPE="git" --build-arg
> VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
> /data1/laiyingchun/dev/ap_kudu_117/docker/Dockerfile --target kudu --tag
> apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
> apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag
> apache/kudu:latest-ubuntu --tag apache/kudu:latest
> /data1/laiyingchun/dev/ap_kudu_117' returned non-zero exit status 1 {code}
> This issue seems can be resolved by [https://gerrit.cloudera.org/c/20299/,]
> but I didn't troubleshoot the root cause.
> 2.
> Enviroment: Rocky 8.6, 20.10.17
> Error:
> {code:java}
> $ python3 ./docker/docker-build.py --action push --platforms linux/amd64
> linux/arm64
> Starting docker build: 2023-09-12T13:43:42.725191
> Version: 1.17.0 (a3cd1ef13)
> ...
> => CACHED [linux/amd64 kudu 6/6] COPY --chown=kudu:kudu
> ./docker/kudu-entrypoint.sh /
>
> 0.0s
> => ERROR [linux/arm64 build 10/17] RUN
> --mount=type=cache,id=ccache,uid=1000,gid=1000,target=/home/kudu/.ccache
> --mount=type=cache,id=gradle-cache,uid=1000,gid=1000,target=/home/kudu/.gradle
> ../../build-support/enable_devtoolset.sh ../../ 727.5s
> ------
> > [linux/arm64 build 10/17] RUN
> --mount=type=cache,id=ccache,uid=1000,gid=1000,target=/home/kudu/.ccache
> --mount=type=cache,id=gradle-cache,uid=1000,gid=1000,target=/home/kudu/.gradle
> ../../build-support/enable_devtoolset.sh
> ../../thirdparty/installed/common/bin/cmake -DCMAKE_BUILD_TYPE=release
> -DKUDU_LINK=static -DKUDU_GIT_HASH=a3cd1ef13 -DNO_TESTS=1 ../.. &&
> make -j4 && sudo make install && if [ "1" == "1" ]; then find "bin" -name
> "kudu*" -type f -exec strip {} ;; fi && if [[ "1" == "1" ]]; then find
> "/usr/local" -name "libkudu*" -type f -exec strip {} ;; fi:
> #0 2.029 -- The C compiler identification is GNU 7.5.0
> #0 2.930 -- The CXX compiler identification is GNU 7.5.0
> ...
> #0 704.1 [100%] Linking CXX executable ../../../bin/kudu
> #0 723.3 [100%] Built target kudu
> #0 723.4 sudo: effective uid is not 0, is /usr/bin/sudo on a file system with
> the 'nosuid' option set or an NFS file system without root privileges?
> ------
> error: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/bash -c
> ../../build-support/enable_devtoolset.sh
> ../../thirdparty/installed/common/bin/cmake -DCMAKE_BUILD_TYPE=$BUILD_TYPE
> -DKUDU_LINK=$LINK_TYPE -DKUDU_GIT_HASH=$VCS_REF -DNO_TESTS=1 ../..
> && make -j${PARALLEL} && sudo make install && if [ \"$STRIP\" == \"1\" ];
> then find \"bin\" -name \"kudu*\" -type f -exec strip {} \\;; fi && if [[
> \"$STRIP\" == \"1\" ]]; then find \"/usr/local\" -name \"libkudu*\" -type f
> -exec strip {} \\;; fi" did not complete successfully: exit code: 1
> Traceback (most recent call last):
> File "./docker/docker-build.py", line 384, in <module>
> main()
> File "./docker/docker-build.py", line 377, in main
> run_command(docker_build_cmd, opts)
> File "./docker/docker-build.py", line 145, in run_command
> subprocess.check_output(cmd, shell=True)
> File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output
> **kwargs).stdout
> File "/usr/lib64/python3.6/subprocess.py", line 438, in run
> output=stdout, stderr=stderr)
> subprocess.CalledProcessError: Command 'docker buildx build --push --platform
> linux/amd64,linux/arm64 --build-arg RUNTIME_BASE_OS="ubuntu:bionic"
> --build-arg DEV_BASE_OS="ubuntu:bionic" --build-arg BASE_OS="ubuntu:bionic"
> --build-arg DOCKERFILE="docker/Dockerfile" --build-arg MAINTAINER="Apache
> Kudu <[email protected]>" --build-arg URL="https://kudu.apache.org";
> --build-arg VERSION="1.17.0" --build-arg VCS_REF="a3cd1ef13" --build-arg
> VCS_TYPE="git" --build-arg
> VCS_URL="https://gitbox.apache.org/repos/asf/kudu.git"; --file
> /data/qdev/laiyingchun/kudu/docker/Dockerfile --target kudu --tag
> apache/kudu:1.17.0-ubuntu --tag apache/kudu:1.17.0 --tag
> apache/kudu:1.17-ubuntu --tag apache/kudu:1.17 --tag
> apache/kudu:latest-ubuntu --tag apache/kudu:latest
> /data/qdev/laiyingchun/kudu' returned non-zero exit status 1. {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
