Agraj Mangal created AIRFLOW-2068:
-------------------------------------
Summary: Mesos Executor should allow specifying optional Docker
image before running command
Key: AIRFLOW-2068
URL: https://issues.apache.org/jira/browse/AIRFLOW-2068
Project: Apache Airflow
Issue Type: Improvement
Components: executor
Affects Versions: Airflow 1.8
Reporter: Agraj Mangal
Assignee: Agraj Mangal
In its current form, MesosExecutor schedules tasks on mesos slaves which just
contain airflow commands assuming that the mesos slaves already have airflow
installed and configured on them. This assumption goes against the Mesos
philosophy of having a heterogeneous cluster.
Since mesos provides an option to pull a docker image before actually running
the actual task/command so this improvement changes the mesos_executor.py to
specify an optional docker image containing airflow which can be pulled on
slaves before running the actual airflow command.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
