Hi,
I'm trying to run Apache Airflow on Mesos and for that, I'm trying to using
MesosExecutor. The trouble is finding the right Python Eggs for Mesos.
Running the MesosExecutor after installing 'mesos.cli' & 'mesos.interface'
via pip gives the following error:
➜ airflow initdb
Traceback (most recent call last):
File "/Users/amangal/anaconda/bin/airflow", line 4, in <module>
__import__('pkg_resources').run_script('apache-airflow==1.10.0.dev0+incubating',
'airflow')
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/setuptools-27.2.0-py3.5.egg/pkg_resources/__init__.py",
line 744, in run_script
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/setuptools-27.2.0-py3.5.egg/pkg_resources/__init__.py",
line 1499, in run_script
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/EGG-INFO/scripts/airflow",
line 17, in <module>
from airflow.bin.cli import CLIFactory
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/bin/cli.py",
line 47, in <module>
from airflow import jobs, settings
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/jobs.py",
line 66, in <module>
class BaseJob(Base, LoggingMixin):
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/jobs.py",
line 98, in BaseJob
executor=executors.GetDefaultExecutor(),
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/executors/__init__.py",
line 42, in GetDefaultExecutor
DEFAULT_EXECUTOR = _get_executor(executor_name)
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/executors/__init__.py",
line 66, in _get_executor
from airflow.contrib.executors.mesos_executor import MesosExecutor
File
"/Users/amangal/anaconda/lib/python3.5/site-packages/apache_airflow-1.10.0.dev0+incubating-py3.5.egg/airflow/contrib/executors/mesos_executor.py",
line 26, in <module>
import mesos.native
*ImportError: No module named 'mesos.native'*
As I understand to resolve this error, I must have the correct Python Eggs
installed. But I could not find out the right location to fetch the correct
eggs for my platform and mesos version. the only available eggs I could
find were:
1.
http://downloads.mesosphere.io/master/ubuntu/14.04/mesos-0.26.0-py2.7-linux-x86_64.egg
2.
http://downloads.mesosphere.io/master/centos/7/mesos-0.22.0-py2.7-linux-x86_64.egg
3.
http://downloads.mesosphere.io/master/ubuntu/12.04/mesos_0.16.0-rc2_amd64.egg
But those look pretty old ?
I can see that some eggs are present in /build/src/python/dist but for my
use-case, I need to install them into a docker image where I'm putting
airflow so I need to download them from some static location and would not
like to make and configure mesos to just download these eggs.
I'm pretty new to both Python & Mesos so would appreciate if you could help
me with this.
--
Thanks & Regards,
Agraj Mangal
