[
https://issues.apache.org/jira/browse/NIFI-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833023#comment-16833023
]
Uday Kale commented on NIFI-4006:
---------------------------------
I am interested in working on this. However, want opinions on whether this is a
good addition to NiFi.
> As a spark developer, I want to add nifi-spark processors to easier integrate
> with Spark cluster
> -------------------------------------------------------------------------------------------------
>
> Key: NIFI-4006
> URL: https://issues.apache.org/jira/browse/NIFI-4006
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Wendell
> Priority: Major
> Labels: Spark
>
> Some customers already had lots of spark job developed for ETL or other batch
> processes. When implemented NiFi for them, they did require an easier way to
> submit spark job from NiFi flow, and query spark job status.
> * Initial nifi-spark processors
> ** Submit asynchronous Spark v1.6.x job to Yarn cluster
> ** Fetch Spark v1.6.x job status from Yarn cluster
> ** Submit asynchronous Spark v2.1.x job to Yarn cluster
> ** Fetch Spark v2.1.x job status from Yarn cluster
> * Security Requirements
> ** Support Kerberized Yarn cluster
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
