[ https://issues.apache.org/jira/browse/AIRFLOW-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16178318#comment-16178318 ]
Fokko Driesprong commented on AIRFLOW-1638: ------------------------------------------- I still had old stuff hanging around. > Add missing dependancies to requires.txt > ---------------------------------------- > > Key: AIRFLOW-1638 > URL: https://issues.apache.org/jira/browse/AIRFLOW-1638 > Project: Apache Airflow > Issue Type: Bug > Reporter: Fokko Driesprong > Assignee: Fokko Driesprong > > Hi All, > There are some missing/outdated dependancies in > ./apache_airflow.egg-info/requires.txt. For testing I use Docker to create a > clean testing environment. When I install it from scratch, I get a dependancy > error when installing the environment using `pip install -e .[devel]`: > ``` > root@1d11d49300ef:/airflow# airflow initdb > Traceback (most recent call last): > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 664, in _build_master > ws.require(__requires__) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 981, in require > needed = self.resolve(parse_requirements(requirements)) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 872, in resolve > raise VersionConflict(dist, req).with_context(dependent_req) > pkg_resources.ContextualVersionConflict: (Flask-WTF 0.12 > (/usr/local/lib/python3.6/site-packages), > Requirement.parse('flask-wtf==0.14'), {'apache-airflow'}) > During handling of the above exception, another exception occurred: > Traceback (most recent call last): > File "/usr/local/bin/airflow", line 4, in <module> > > __import__('pkg_resources').require('apache-airflow==1.10.0.dev0+incubating') > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3074, in <module> > @_call_aside > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3058, in _call_aside > f(*args, **kwargs) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3087, in _initialize_master_working_set > working_set = WorkingSet._build_master() > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 666, in _build_master > return cls._build_from_requirements(__requires__) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 679, in _build_from_requirements > dists = ws.resolve(reqs, Environment()) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 867, in resolve > raise DistributionNotFound(req, requirers) > pkg_resources.DistributionNotFound: The 'flask-wtf==0.14' distribution was > not found and is required by apache-airflow > ``` > This is due mismatch of dependancies in `airflow.egg-info/requires.txt`: > ``` > Fokkos-MacBook-Pro:incubator-airflow fokkodriesprong$ grep -i -R "flask-wtf" . > ./airflow.egg-info/requires.txt:flask-wtf==0.12 > ./apache_airflow.egg-info/requires.txt:flask-wtf==0.14 > ``` > Therefore I would like to upgrade the Flask-WTF from 0.12 to 0.14. > Same for the bleach dependancy which was missing: > ``` > root@2ffd781e2db3:/airflow# airflow initdb > Traceback (most recent call last): > File "/usr/local/bin/airflow", line 4, in <module> > > __import__('pkg_resources').require('apache-airflow==1.10.0.dev0+incubating') > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3074, in <module> > @_call_aside > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3058, in _call_aside > f(*args, **kwargs) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 3087, in _initialize_master_working_set > working_set = WorkingSet._build_master() > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 664, in _build_master > ws.require(__requires__) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 981, in require > needed = self.resolve(parse_requirements(requirements)) > File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", > line 867, in resolve > raise DistributionNotFound(req, requirers) > pkg_resources.DistributionNotFound: The 'bleach==2.0.0' distribution was not > found and is required by apache-airflow > ``` > I've added this requirement for the development environment. > Cheers, Fokko -- This message was sent by Atlassian JIRA (v6.4.14#64029)