[
https://issues.apache.org/jira/browse/AIRFLOW-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885709#comment-15885709
]
ASF subversion and git services commented on AIRFLOW-1:
-------------------------------------------------------
Commit 5831652f3fb1a6f296c8852513ed38427c897dd6 in incubator-airflow's branch
refs/heads/master from [~Fokko]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=5831652 ]
[AIRFLOW-802][AIRFLOW-1] Add spark-submit operator/hook
Add a operator for spark-submit to kick off Apache
Spark jobs by
using Airflow. This allows the user to maintain
the configuration
of the master and yarn queue within Airflow by
using connections.
Add default connection_id to the initdb routine to
set spark
to yarn by default. Add unit tests to verify the
behaviour of
the spark-submit operator and hook.
Closes #2042 from Fokko/airflow-802
> Migrate GitHub code to Apache git
> ---------------------------------
>
> Key: AIRFLOW-1
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1
> Project: Apache Airflow
> Issue Type: Improvement
> Components: project-management
> Reporter: Maxime Beauchemin
> Assignee: Maxime Beauchemin
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
