iemejia commented on pull request #14832:
URL: https://github.com/apache/beam/pull/14832#issuecomment-858718604
I saw some error messages because of wheels not available on other
dependencies.
```
Processing ./apache_beam-2.32.0.dev0-cp38-cp38-manylinux2014_aarch64.whl
Requirement already satisfied: grpcio<2,>=1.29.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.38.0)
Requirement already satisfied: httplib2<0.20.0,>=0.8 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.19.1)
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Using cached avro-python3-1.9.2.1.tar.gz (37 kB)
Requirement already satisfied: numpy<1.21.0,>=1.14.3 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.20.3)
Collecting pyarrow<5.0.0,>=0.15.1
Using cached pyarrow-4.0.1-cp38-cp38-manylinux2014_aarch64.whl (20.3 MB)
Requirement already satisfied: pydot<2,>=1.2.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.4.2)
Collecting protobuf<4,>=3.12.2
Using cached protobuf-3.17.3-cp38-cp38-manylinux2014_aarch64.whl (923 kB)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (2021.1)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Requirement already satisfied: oauth2client<5,>=2.0.1 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (4.1.3)
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7.tar.gz (89 kB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.18.2)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Requirement already satisfied: fastavro<2,>=0.21.4 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (1.4.1)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (3.11.4)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
apache-beam==2.32.0.dev0) (0.3.1.1)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Requirement already satisfied: six>=1.5.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
grpcio<2,>=1.29.0->apache-beam==2.32.0.dev0) (1.16.0)
Requirement already satisfied: pyparsing<3,>=2.4.2 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
httplib2<0.20.0,>=0.8->apache-beam==2.32.0.dev0) (2.4.7)
Collecting docopt
Using cached docopt-0.6.2.tar.gz (25 kB)
Requirement already satisfied: pyasn1>=0.1.7 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (0.2.8)
Requirement already satisfied: rsa>=3.1.4 in
./.virtualenvs/beamtest2/lib/python3.8/site-packages (from
oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (4.7.2)
Collecting chardet<5,>=3.0.2
Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.5-py2.py3-none-any.whl (138 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.5.30-py2.py3-none-any.whl (145 kB)
Building wheels for collected packages: avro-python3, crcmod, docopt
Building wheel for avro-python3 (setup.py): started
Building wheel for avro-python3 (setup.py): finished with status 'error'
Running setup.py clean for avro-python3
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'error'
Running setup.py clean for crcmod
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'error'
Running setup.py clean for docopt
Failed to build avro-python3 crcmod docopt
Installing collected packages: avro-python3, pyarrow, protobuf, docopt,
chardet, urllib3, idna, certifi, requests, hdfs, crcmod, typing-extensions,
apache-beam
Running setup.py install for avro-python3: started
Running setup.py install for avro-python3: finished with status 'error'
```
Curious I thought Beam did not use Apache Avro after the move to Python 3 or
is it there only for backwards compatibility for users?
Also in case that is the reason we should move the avro dependency to be the
'new' avro one, for ref https://pypi.org/project/avro-python3/ is deprecated
now in favor of https://pypi.org/project/avro/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
