[
https://issues.apache.org/jira/browse/HADOOP-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780596#comment-17780596
]
kailiu_dev edited comment on HADOOP-18052 at 10/28/23 8:02 AM:
---------------------------------------------------------------
[~aajisaka] hello, in my mac pro, I use the start-build-env.sh to build hadoop
(branch-3.3.2) docker, but get error:
{code:java}
./start-build-env.sh
[+] Building 19.4s (13/17)
=> [internal] load build definition from Dockerfile_aarch64 0.0s
=> => transferring dockerfile: 45B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/ubuntu:bionic 3.1s
=> [ 1/13] FROM docker.io/library/ubuntu:bionic@sha256:152dc042452c49600 0.0s
=> [internal] load build context 0.0s
=> => transferring context: 42B 0.0s
=> CACHED [ 2/13] WORKDIR /root 0.0s
=> CACHED [ 3/13] RUN echo APT::Install-Recommends "0"; > /etc/apt/apt.c 0.0s
=> CACHED [ 4/13] RUN echo APT::Install-Suggests "0"; >> /etc/apt/apt.c 0.0s
=> CACHED [ 5/13] RUN apt-get -q update && apt-get -q install -y --n 0.0s
=> CACHED [ 6/13] RUN locale-gen en_US.UTF-8 0.0s
=> CACHED [ 7/13] RUN mkdir -p /opt/spotbugs && curl -L -s -S https: 0.0s
=> CACHED [ 8/13] RUN mkdir -p /opt/protobuf-src && curl -L -s -S 0.0s
=> ERROR [ 9/13] RUN pip3 install pylint==2.6.0 python-dateutil==2.8.1 16.2s
------
> [ 9/13] RUN pip3 install pylint==2.6.0 python-dateutil==2.8.1:
#12 0.917 Collecting pylint==2.6.0
#12 2.533 Downloading
https://files.pythonhosted.org/packages/fb/13/519c1264a134beab2be4bac8dd3e64948980a5ca7833b31cf0255b21f20a/pylint-2.6.0-py3-none-any.whl
(325kB)
#12 2.921 Collecting python-dateutil==2.8.1
#12 3.940 Downloading
https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl
(227kB)
#12 4.021 Collecting toml>=0.7.1 (from pylint==2.6.0)
#12 4.572 Downloading
https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl
#12 4.603 Collecting mccabe<0.7,>=0.6 (from pylint==2.6.0)
#12 5.164 Downloading
https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl
#12 5.189 Collecting astroid<=2.5,>=2.4.0 (from pylint==2.6.0)
#12 5.854 Downloading
https://files.pythonhosted.org/packages/ff/f0/2364d469327ffef8ee1964a5995f8206fd22fcfa57f2618498f8b963329f/astroid-2.5-py3-none-any.whl
(220kB)
#12 5.920 Collecting isort<6,>=4.2.5 (from pylint==2.6.0)
#12 6.570 Downloading
https://files.pythonhosted.org/packages/b8/5b/f18e227df38b94b4ee30d2502fd531bebac23946a2497e5595067a561274/isort-5.10.1-py3-none-any.whl
(103kB)
#12 6.610 Collecting six>=1.5 (from python-dateutil==2.8.1)
#12 7.581 Downloading
https://files.pythonhosted.org/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl
#12 7.612 Collecting wrapt<1.13,>=1.11 (from
astroid<=2.5,>=2.4.0->pylint==2.6.0)
#12 8.428 Downloading
https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz
#12 8.613 Collecting lazy-object-proxy>=1.4.0 (from
astroid<=2.5,>=2.4.0->pylint==2.6.0)
#12 9.251 Downloading
https://files.pythonhosted.org/packages/75/93/3fc1cc28f71dd10b87a53b9d809602d7730e84cc4705a062def286232a9c/lazy-object-proxy-1.7.1.tar.gz
(41kB)
#12 16.11 Complete output from command python setup.py egg_info:
#12 16.11 Traceback (most recent call last):
#12 16.11 File "<string>", line 1, in <module>
#12 16.11 File "/tmp/pip-build-55rycmga/lazy-object-proxy/setup.py", line
146, in <module>
#12 16.11 distclass=BinaryDistribution,
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/__init__.py",
line 129, in setup
#12 16.11 return distutils.core.setup(**attrs)
#12 16.11 File "/usr/lib/python3.6/distutils/core.py", line 108, in setup
#12 16.11 _setup_distribution = dist = klass(attrs)
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/dist.py", line
372, in __init__
#12 16.11 _Distribution.__init__(self, attrs)
#12 16.11 File "/usr/lib/python3.6/distutils/dist.py", line 281, in
__init__
#12 16.11 self.finalize_options()
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/dist.py", line
528, in finalize_options
#12 16.11 ep.load()(self, ep.name, value)
#12 16.11 File
"/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2324, in load
#12 16.11 return self.resolve()
#12 16.11 File
"/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2330, in
resolve
#12 16.11 module = __import__(self.module_name, fromlist=['__name__'],
level=0)
#12 16.11 File
"/tmp/pip-build-55rycmga/lazy-object-proxy/.eggs/setuptools_scm-8.0.4-py3.6.egg/setuptools_scm/__init__.py",
line 5
#12 16.11 from __future__ import annotations
#12 16.11 ^
#12 16.11 SyntaxError: future feature annotations is not defined
#12 16.11
#12 16.11 ----------------------------------------
#12 16.13 Command "python setup.py egg_info" failed with error code 1 in
/tmp/pip-build-55rycmga/lazy-object-proxy/
------
executor failed running [/bin/bash -o pipefail -c pip3 install pylint==2.6.0
python-dateutil==2.8.1]: exit code: 1
{code}
can you help me, how can I solve this problem？
my mac. is. : MacBook Pro (13-inch, M1, 2020)
my mac shell python version is ：Python 3.8.2
was (Author: kailiu_dev):
[~aajisaka] hello, in my mac pro, I use the start-build-env.sh to build hadoop
(branch-3.3.2) docker, but get error:
{code:java}
./start-build-env.sh
[+] Building 19.4s (13/17)
=> [internal] load build definition from Dockerfile_aarch64 0.0s
=> => transferring dockerfile: 45B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/ubuntu:bionic 3.1s
=> [ 1/13] FROM docker.io/library/ubuntu:bionic@sha256:152dc042452c49600 0.0s
=> [internal] load build context 0.0s
=> => transferring context: 42B 0.0s
=> CACHED [ 2/13] WORKDIR /root 0.0s
=> CACHED [ 3/13] RUN echo APT::Install-Recommends "0"; > /etc/apt/apt.c 0.0s
=> CACHED [ 4/13] RUN echo APT::Install-Suggests "0"; >> /etc/apt/apt.c 0.0s
=> CACHED [ 5/13] RUN apt-get -q update && apt-get -q install -y --n 0.0s
=> CACHED [ 6/13] RUN locale-gen en_US.UTF-8 0.0s
=> CACHED [ 7/13] RUN mkdir -p /opt/spotbugs && curl -L -s -S https: 0.0s
=> CACHED [ 8/13] RUN mkdir -p /opt/protobuf-src && curl -L -s -S 0.0s
=> ERROR [ 9/13] RUN pip3 install pylint==2.6.0 python-dateutil==2.8.1 16.2s
------
> [ 9/13] RUN pip3 install pylint==2.6.0 python-dateutil==2.8.1:
#12 0.917 Collecting pylint==2.6.0
#12 2.533 Downloading
https://files.pythonhosted.org/packages/fb/13/519c1264a134beab2be4bac8dd3e64948980a5ca7833b31cf0255b21f20a/pylint-2.6.0-py3-none-any.whl
(325kB)
#12 2.921 Collecting python-dateutil==2.8.1
#12 3.940 Downloading
https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl
(227kB)
#12 4.021 Collecting toml>=0.7.1 (from pylint==2.6.0)
#12 4.572 Downloading
https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl
#12 4.603 Collecting mccabe<0.7,>=0.6 (from pylint==2.6.0)
#12 5.164 Downloading
https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl
#12 5.189 Collecting astroid<=2.5,>=2.4.0 (from pylint==2.6.0)
#12 5.854 Downloading
https://files.pythonhosted.org/packages/ff/f0/2364d469327ffef8ee1964a5995f8206fd22fcfa57f2618498f8b963329f/astroid-2.5-py3-none-any.whl
(220kB)
#12 5.920 Collecting isort<6,>=4.2.5 (from pylint==2.6.0)
#12 6.570 Downloading
https://files.pythonhosted.org/packages/b8/5b/f18e227df38b94b4ee30d2502fd531bebac23946a2497e5595067a561274/isort-5.10.1-py3-none-any.whl
(103kB)
#12 6.610 Collecting six>=1.5 (from python-dateutil==2.8.1)
#12 7.581 Downloading
https://files.pythonhosted.org/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl
#12 7.612 Collecting wrapt<1.13,>=1.11 (from
astroid<=2.5,>=2.4.0->pylint==2.6.0)
#12 8.428 Downloading
https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz
#12 8.613 Collecting lazy-object-proxy>=1.4.0 (from
astroid<=2.5,>=2.4.0->pylint==2.6.0)
#12 9.251 Downloading
https://files.pythonhosted.org/packages/75/93/3fc1cc28f71dd10b87a53b9d809602d7730e84cc4705a062def286232a9c/lazy-object-proxy-1.7.1.tar.gz
(41kB)
#12 16.11 Complete output from command python setup.py egg_info:
#12 16.11 Traceback (most recent call last):
#12 16.11 File "<string>", line 1, in <module>
#12 16.11 File "/tmp/pip-build-55rycmga/lazy-object-proxy/setup.py", line
146, in <module>
#12 16.11 distclass=BinaryDistribution,
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/__init__.py",
line 129, in setup
#12 16.11 return distutils.core.setup(**attrs)
#12 16.11 File "/usr/lib/python3.6/distutils/core.py", line 108, in setup
#12 16.11 _setup_distribution = dist = klass(attrs)
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/dist.py", line
372, in __init__
#12 16.11 _Distribution.__init__(self, attrs)
#12 16.11 File "/usr/lib/python3.6/distutils/dist.py", line 281, in
__init__
#12 16.11 self.finalize_options()
#12 16.11 File "/usr/lib/python3/dist-packages/setuptools/dist.py", line
528, in finalize_options
#12 16.11 ep.load()(self, ep.name, value)
#12 16.11 File
"/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2324, in load
#12 16.11 return self.resolve()
#12 16.11 File
"/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2330, in
resolve
#12 16.11 module = __import__(self.module_name, fromlist=['__name__'],
level=0)
#12 16.11 File
"/tmp/pip-build-55rycmga/lazy-object-proxy/.eggs/setuptools_scm-8.0.4-py3.6.egg/setuptools_scm/__init__.py",
line 5
#12 16.11 from __future__ import annotations
#12 16.11 ^
#12 16.11 SyntaxError: future feature annotations is not defined
#12 16.11
#12 16.11 ----------------------------------------
#12 16.13 Command "python setup.py egg_info" failed with error code 1 in
/tmp/pip-build-55rycmga/lazy-object-proxy/
------
executor failed running [/bin/bash -o pipefail -c pip3 install pylint==2.6.0
python-dateutil==2.8.1]: exit code: 1
{code}
can you help me, how can I solve this problem？
my mac. is. : MacBook Pro (13-inch, M1, 2020)
in，mac shell python version is ：Python 3.8.2
> Support Apple Silicon in start-build-env.sh
> -------------------------------------------
>
> Key: HADOOP-18052
> URL: https://issues.apache.org/jira/browse/HADOOP-18052
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Environment: M1 Pro. MacOS 12.0.1. Docker for Mac.
> Reporter: Akira Ajisaka
> Assignee: Akira Ajisaka
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.2
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> start-build-env.sh uses Dockerfile for x86 in M1 Mac, and the Dockerfile sets
> wrong JAVA_HOME. Dockerfile_aarch64 should be used instead.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
