[jira] [Commented] (AIRFLOW-5605) Docker image requirement anaconda-client 1.7.2 not found
[
https://issues.apache.org/jira/browse/AIRFLOW-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946904#comment-16946904
]
Ash Berlin-Taylor commented on AIRFLOW-5605:
Those scripts are just meant for CI. They are not meant for use outside of
Airflow's own CI process.
The problem is that script is just getting the list of modules you have
installed on your local python, and it is trying to just "reinstall" everything.
> Docker image requirement anaconda-client 1.7.2 not found
>
>
> Key: AIRFLOW-5605
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5605
> Project: Apache Airflow
> Issue Type: Bug
> Components: dependencies
>Affects Versions: 1.10.5
> Environment: OS: Ubuntu 18.04
> Docker: `docker version`
> Client:
> Version: 18.09.7
> API version: 1.39
> Go version:go1.10.8
> Git commit:2d0083d
> Built: Thu Jun 27 17:56:23 2019
> OS/Arch: linux/amd64
> Experimental: false
> Server: Docker Engine - Community
> Engine:
> Version: 18.09.7
> API version: 1.39 (minimum version 1.12)
> Go version: go1.10.8
> Git commit: 2d0083d
> Built:Thu Jun 27 17:23:02 2019
> OS/Arch: linux/amd64
> Experimental: false
>Reporter: Iemand
>Priority: Major
> Labels: Docker, dockerfile
> Attachments: airflow-docker_issue_anaconda-client1.7.2.txt
>
>
> Trying to build an Airflow Docker image, but hitting the error:
> {code:java}
> Step 6/12 : RUN pip install -r /tmp/requirements.txt
> ---> Running in dad143582dff
> Collecting alabaster==0.7.11 (from -r /tmp/requirements.txt (line 1))
> Downloading
> https://files.pythonhosted.org/packages/6e/71/c3648cc2f675063dbe2d669004a59e4a5120172713a1de3c3b14144d4b31/alabaster-0.7.11-py2.py3-none-any.whl
> Collecting alembic==1.0.11 (from -r /tmp/requirements.txt (line 2))
> Downloading
> https://files.pythonhosted.org/packages/7b/8b/0c98c378d93165d9809193f274c3c6e2151120d955b752419c7d43e4d857/alembic-1.0.11.tar.gz
> (1.0MB)
> Collecting anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3))
> ERROR: Could not find a version that satisfies the requirement
> anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3)) (from
> versions: 1.1.1, 1.2.2)
> ERROR: No matching distribution found for anaconda-client==1.7.2 (from -r
> /tmp/requirements.txt (line 3))
> The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a
> non-zero code: 1{code}
>
> Please see attached .txt for full output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (AIRFLOW-5605) Docker image requirement anaconda-client 1.7.2 not found
[
https://issues.apache.org/jira/browse/AIRFLOW-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946380#comment-16946380
]
Iemand commented on AIRFLOW-5605:
-
Ok, somehow the attachement didn't work,
`airflow/scripts/ci/kubernetes/docker/requirements.txt`:
{code:java}
alabaster==0.7.11
alembic==1.0.11
anaconda-client==1.7.2
anaconda-navigator==1.9.2
anaconda-project==0.8.2
apispec==2.0.2
appdirs==1.4.3
asn1crypto==0.24.0
astroid==2.0.4
astropy==3.0.4
atomicwrites==1.2.1
attrs==18.2.0
Automat==0.7.0
Babel==2.6.0
backcall==0.1.0
backports.shutil-get-terminal-size==1.0.0
beautifulsoup4==4.6.3
bitarray==0.8.3
bkcharts==0.2
blaze==0.11.3
bleach==2.1.4
bokeh==0.13.0
boto==2.49.0
Bottleneck==1.2.1
cached-property==1.5.1
certifi==2019.6.16
cffi==1.12.3
chardet==3.0.4
click==6.7
cloudpickle==0.5.5
clyent==1.2.2
colorama==0.3.9
colorlog==4.0.2
comet-git-pure==0.19.8
comet-ml==1.0.38
conda==4.7.10
conda-build==3.15.1
conda-package-handling==1.3.11
configobj==5.0.6
configparser==3.5.3
constantly==15.1.0
contextlib2==0.5.5
core-data-management==0.0.1
core-empath-boss==0.0.1
core-model-construction==0.0.1
croniter==0.3.30
cryptography==2.7
cycler==0.10.0
Cython==0.28.5
cytoolz==0.9.0.1
dask==0.19.1
datashape==0.5.4
decorator==4.3.0
defusedxml==0.5.0
dill==0.2.9
distributed==1.23.1
docutils==0.14
dumb-init==1.2.2
entrypoints==0.2.3
et-xmlfile==1.0.1
everett==0.9
fastcache==1.0.2
filelock==3.0.8
Flask==1.1.1
Flask-Admin==1.5.3
Flask-AppBuilder==1.13.1
Flask-Babel==0.12.2
Flask-Caching==1.3.3
Flask-Cors==3.0.6
Flask-JWT-Extended==3.21.0
Flask-Login==0.4.1
Flask-OpenID==1.2.5
Flask-SQLAlchemy==2.4.0
flask-swagger==0.2.13
Flask-WTF==0.14.2
funcsigs==1.0.0
future==0.16.0
gevent==1.3.6
glob2==0.6
gmpy2==2.0.8
greenlet==0.4.15
gunicorn==19.9.0
h5py==2.8.0
heapdict==1.0.0
html5lib==1.0.1
hyperlink==18.0.0
idna==2.8
imageio==2.4.1
imagesize==1.1.0
incremental==17.5.0
ipykernel==4.9.0
ipython==6.5.0
ipython-genutils==0.2.0
ipywidgets==7.4.1
iso8601==0.1.12
isort==4.3.4
itsdangerous==0.24
jdcal==1.4
jedi==0.12.1
jeepney==0.3.1
Jinja2==2.10.1
json-merge-patch==0.2
jsonschema==3.0.2
jupyter==1.0.0
jupyter-client==5.2.3
jupyter-console==5.2.0
jupyter-core==4.4.0
jupyterlab==0.34.9
jupyterlab-launcher==0.13.1
keyring==13.2.1
kiwisolver==1.0.1
lazy-object-proxy==1.3.1
libarchive-c==2.8
llvmlite==0.24.0
locket==0.2.0
lockfile==0.12.2
lxml==4.2.5
Mako==1.1.0
Markdown==2.6.11
MarkupSafe==1.0
marshmallow==2.19.5
marshmallow-enum==1.4.1
marshmallow-sqlalchemy==0.17.0
matplotlib==2.2.3
mccabe==0.6.1
mistune==0.8.3
mkl-fft==1.0.4
mkl-random==1.0.1
more-itertools==4.3.0
mpmath==1.0.0
msgpack==0.5.6
multipledispatch==0.6.0
navigator-updater==0.2.1
nbconvert==5.4.0
nbformat==4.4.0
netifaces==0.10.7
networkx==2.1
nltk==3.3
nose==1.3.7
notebook==5.6.0
numba==0.39.0
numexpr==2.6.8
numpy==1.15.1
numpydoc==0.8.0
nvidia-ml-py3==7.352.0
odo==0.5.1
olefile==0.46
openpyxl==2.5.6
ordereddict==1.1
packaging==17.1
pandas==0.23.4
pandocfilters==1.4.2
parso==0.3.1
partd==0.3.8
path.py==11.1.0
pathlib2==2.3.2
patsy==0.5.0
pendulum==1.4.4
pep8==1.7.1
pexpect==4.6.0
pickleshare==0.7.4
Pillow==5.2.0
pkginfo==1.4.2
pluggy==0.7.1
ply==3.11
prison==0.1.0
prometheus-client==0.3.1
prompt-toolkit==1.0.15
psutil==5.4.7
psycopg2==2.7.7
ptyprocess==0.6.0
py==1.6.0
pyasn1==0.4.4
pyasn1-modules==0.2.2
pycodestyle==2.4.0
pycosat==0.6.3
pycparser==2.19
pycrypto==2.6.1
pycurl==7.43.0.2
pyflakes==2.0.0
Pygments==2.2.0
PyJWT==1.7.1
pylint==2.1.1
pyodbc==4.0.24
pyOpenSSL==19.0.0
pyparsing==2.2.0
pyrsistent==0.15.4
PySocks==1.7.0
pytest==3.8.0
pytest-arraydiff==0.2
pytest-astropy==0.4.0
pytest-doctestplus==0.1.3
pytest-openfiles==0.3.0
pytest-remotedata==0.3.0
python-daemon==2.1.2
python-dateutil==2.7.3
python-editor==1.0.4
python3-openid==3.1.0
pytz==2018.5
pytzdata==2019.2
PyWavelets==1.0.0
PyYAML==3.13
pyzmq==17.1.2
QtAwesome==0.4.4
qtconsole==4.4.1
QtPy==1.5.0
requests==2.22.0
rope==0.11.0
ruamel-yaml==0.15.46
scikit-image==0.14.0
scikit-learn==0.19.2
scipy==1.1.0
seaborn==0.9.0
SecretStorage==3.1.0
Send2Trash==1.5.0
service-identity==17.0.0
setproctitle==1.1.10
simplegeneric==0.8.1
singledispatch==3.4.0.3
six==1.12.0
smop==0.41b0
snowballstemmer==1.2.1
sortedcollections==1.0.1
sortedcontainers==2.0.5
Sphinx==1.7.9
sphinxcontrib-websupport==1.1.0
spyder==3.3.1
spyder-kernels==0.2.6
SQLAlchemy==1.3.6
statsmodels==0.9.0
sympy==1.2
tables==3.4.4
tabulate==0.8.3
tblib==1.3.2
tenacity==4.12.0
termcolor==1.1.0
terminado==0.8.1
testpath==0.3.1
text-unidecode==1.2
thrift==0.11.0
toolz==0.9.0
tornado==5.1
tqdm==4.32.1
traitlets==4.3.2
Twisted==18.7.0
tzlocal==1.5.1
unicodecsv==0.14.1
urllib3==1.24.2
wcwidth==0.1.7
webencodings==0.5.1
websocket-client==0.54.0
Werkzeug==0.15.5
widgetsnbextension==3.4.1
wrapt==1.10.11
WTForms==2.2.1
wurlitzer==1.0.2
xgboost==0.90
xlrd==1.1.0
XlsxWriter==1.1.0
xlwt==1.3.0
zict==0.1.3
zope.deprecation==4.4.0
zope.interface==4.5.0{code}
> Docker image requirement anaconda-client 1.7.2
[jira] [Commented] (AIRFLOW-5605) Docker image requirement anaconda-client 1.7.2 not found
[
https://issues.apache.org/jira/browse/AIRFLOW-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946379#comment-16946379
]
Iemand commented on AIRFLOW-5605:
-
Attached `requirements.txt`
> Docker image requirement anaconda-client 1.7.2 not found
>
>
> Key: AIRFLOW-5605
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5605
> Project: Apache Airflow
> Issue Type: Bug
> Components: dependencies
>Affects Versions: 1.10.5
> Environment: OS: Ubuntu 18.04
> Docker: `docker version`
> Client:
> Version: 18.09.7
> API version: 1.39
> Go version:go1.10.8
> Git commit:2d0083d
> Built: Thu Jun 27 17:56:23 2019
> OS/Arch: linux/amd64
> Experimental: false
> Server: Docker Engine - Community
> Engine:
> Version: 18.09.7
> API version: 1.39 (minimum version 1.12)
> Go version: go1.10.8
> Git commit: 2d0083d
> Built:Thu Jun 27 17:23:02 2019
> OS/Arch: linux/amd64
> Experimental: false
>Reporter: Iemand
>Priority: Major
> Labels: Docker, dockerfile
> Attachments: airflow-docker_issue_anaconda-client1.7.2.txt
>
>
> Trying to build an Airflow Docker image, but hitting the error:
> {code:java}
> Step 6/12 : RUN pip install -r /tmp/requirements.txt
> ---> Running in dad143582dff
> Collecting alabaster==0.7.11 (from -r /tmp/requirements.txt (line 1))
> Downloading
> https://files.pythonhosted.org/packages/6e/71/c3648cc2f675063dbe2d669004a59e4a5120172713a1de3c3b14144d4b31/alabaster-0.7.11-py2.py3-none-any.whl
> Collecting alembic==1.0.11 (from -r /tmp/requirements.txt (line 2))
> Downloading
> https://files.pythonhosted.org/packages/7b/8b/0c98c378d93165d9809193f274c3c6e2151120d955b752419c7d43e4d857/alembic-1.0.11.tar.gz
> (1.0MB)
> Collecting anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3))
> ERROR: Could not find a version that satisfies the requirement
> anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3)) (from
> versions: 1.1.1, 1.2.2)
> ERROR: No matching distribution found for anaconda-client==1.7.2 (from -r
> /tmp/requirements.txt (line 3))
> The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a
> non-zero code: 1{code}
>
> Please see attached .txt for full output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (AIRFLOW-5605) Docker image requirement anaconda-client 1.7.2 not found
[
https://issues.apache.org/jira/browse/AIRFLOW-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946375#comment-16946375
]
Iemand commented on AIRFLOW-5605:
-
[~ash]
I would assume that too, but somehow the `requirements.txt` downloaded through
the `build.sh` line 47 has this included:
[https://github.com/apache/airflow/blob/master/scripts/ci/kubernetes/docker/build.sh#L47]
I just followed the steps given by this README.md:
[https://github.com/apache/airflow/tree/master/scripts/ci/kubernetes]
Doing: `{{./docker/build.sh}}`
> Docker image requirement anaconda-client 1.7.2 not found
>
>
> Key: AIRFLOW-5605
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5605
> Project: Apache Airflow
> Issue Type: Bug
> Components: dependencies
>Affects Versions: 1.10.5
> Environment: OS: Ubuntu 18.04
> Docker: `docker version`
> Client:
> Version: 18.09.7
> API version: 1.39
> Go version:go1.10.8
> Git commit:2d0083d
> Built: Thu Jun 27 17:56:23 2019
> OS/Arch: linux/amd64
> Experimental: false
> Server: Docker Engine - Community
> Engine:
> Version: 18.09.7
> API version: 1.39 (minimum version 1.12)
> Go version: go1.10.8
> Git commit: 2d0083d
> Built:Thu Jun 27 17:23:02 2019
> OS/Arch: linux/amd64
> Experimental: false
>Reporter: Iemand
>Priority: Major
> Labels: Docker, dockerfile
> Attachments: airflow-docker_issue_anaconda-client1.7.2.txt
>
>
> Trying to build an Airflow Docker image, but hitting the error:
> {code:java}
> Step 6/12 : RUN pip install -r /tmp/requirements.txt
> ---> Running in dad143582dff
> Collecting alabaster==0.7.11 (from -r /tmp/requirements.txt (line 1))
> Downloading
> https://files.pythonhosted.org/packages/6e/71/c3648cc2f675063dbe2d669004a59e4a5120172713a1de3c3b14144d4b31/alabaster-0.7.11-py2.py3-none-any.whl
> Collecting alembic==1.0.11 (from -r /tmp/requirements.txt (line 2))
> Downloading
> https://files.pythonhosted.org/packages/7b/8b/0c98c378d93165d9809193f274c3c6e2151120d955b752419c7d43e4d857/alembic-1.0.11.tar.gz
> (1.0MB)
> Collecting anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3))
> ERROR: Could not find a version that satisfies the requirement
> anaconda-client==1.7.2 (from -r /tmp/requirements.txt (line 3)) (from
> versions: 1.1.1, 1.2.2)
> ERROR: No matching distribution found for anaconda-client==1.7.2 (from -r
> /tmp/requirements.txt (line 3))
> The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a
> non-zero code: 1{code}
>
> Please see attached .txt for full output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
