[
https://issues.apache.org/jira/browse/BEAM-10982?focusedWorklogId=609767&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609767
]
ASF GitHub Bot logged work on BEAM-10982:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 10/Jun/21 15:25
Start Date: 10/Jun/21 15:25
Worklog Time Spent: 10m
Work Description: iemejia commented on pull request #14832:
URL: https://github.com/apache/beam/pull/14832#issuecomment-858718604
I saw some error messages because of wheels not available on other
dependencies.
```
Processing ./apache_beam-2.32.0.dev0-cp38-cp38-manylinux2014_aarch64.whl
Requirement already satisfied: grpcio<2,>=1.29.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.38.0)
Requirement already satisfied: httplib2<0.20.0,>=0.8 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.19.1)
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Using cached avro-python3-1.9.2.1.tar.gz (37 kB)
Requirement already satisfied: numpy<1.21.0,>=1.14.3 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.20.3)
Collecting pyarrow<5.0.0,>=0.15.1
Using cached pyarrow-4.0.1-cp38-cp38-manylinux2014_aarch64.whl (20.3 MB)
Requirement already satisfied: pydot<2,>=1.2.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.4.2)
Collecting protobuf<4,>=3.12.2
Using cached protobuf-3.17.3-cp38-cp38-manylinux2014_aarch64.whl (923 kB)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (2021.1)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Requirement already satisfied: oauth2client<5,>=2.0.1 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (4.1.3)
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7.tar.gz (89 kB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.18.2)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Requirement already satisfied: fastavro<2,>=0.21.4 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.4.1)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (3.11.4)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.3.1.1)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Requirement already satisfied: six>=1.5.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
grpcio<2,>=1.29.0->apache-beam==2.32.0.dev0) (1.16.0)
Requirement already satisfied: pyparsing<3,>=2.4.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
httplib2<0.20.0,>=0.8->apache-beam==2.32.0.dev0) (2.4.7)
Collecting docopt
Using cached docopt-0.6.2.tar.gz (25 kB)
Requirement already satisfied: pyasn1>=0.1.7 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (0.2.8)
Requirement already satisfied: rsa>=3.1.4 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (4.7.2)
Collecting chardet<5,>=3.0.2
Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.5-py2.py3-none-any.whl (138 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.5.30-py2.py3-none-any.whl (145 kB)
Building wheels for collected packages: avro-python3, crcmod, docopt
Building wheel for avro-python3 (setup.py): started
Building wheel for avro-python3 (setup.py): finished with status 'error'
Running setup.py clean for avro-python3
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'error'
Running setup.py clean for crcmod
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'error'
Running setup.py clean for docopt
Failed to build avro-python3 crcmod docopt
Installing collected packages: avro-python3, pyarrow, protobuf, docopt,
chardet, urllib3, idna, certifi, requests, hdfs, crcmod, typing-extensions,
apache-beam
Running setup.py install for avro-python3: started
Running setup.py install for avro-python3: finished with status 'error'
```
Curious I thought Beam did not use Apache Avro after the move to Python 3 or
is it there only for backwards compatibility for users?
Also in case that is the reason we should move the avro dependency to be the
'new' avro one, for ref https://pypi.org/project/avro-python3/ is deprecated
now in favor of https://pypi.org/project/avro/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 609767)
Time Spent: 2h (was: 1h 50m)
> Wheel support for linux aarch64
> -------------------------------
>
> Key: BEAM-10982
> URL: https://issues.apache.org/jira/browse/BEAM-10982
> Project: Beam
> Issue Type: New Feature
> Components: build-system, sdk-py-core
> Reporter: odidev
> Priority: P3
> Time Spent: 2h
> Remaining Estimate: 0h
>
> *Summary*
> Installing apache-beam on aarch64 via pip using command "pip3 install
> apache-beam" tries to build wheel from source code
> *Problem description*
> apache-beam doesn't have wheel for aarch64 on PyPI repository. So, while
> installing apache-beam via pip on aarch64, pip builds wheel for same
> resulting in it takes more time to install apache-beam. Making wheel
> available for aarch64 will benefit aarch64 users by minimizing apache-beam
> installation time.
> *Expected Output*
> Pip should be able to download apache-beam wheel from PyPI repository rather
> than building it from source code.
> @apache-beam-team, please let me know if I can help you building
> wheel/uploading to PyPI repository. I am curious to make apache-beam wheel
> available for aarch64. It will be a great opportunity for me to work with you.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
