Mageswaran created NIFI-4946:
--------------------------------

             Summary: nifi-spark-bundle : Adding support for pyfiles, file, 
jars options
                 Key: NIFI-4946
                 URL: https://issues.apache.org/jira/browse/NIFI-4946
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
    Affects Versions: 1.6.0
         Environment: Ubuntu 16.04, IntelliJ
            Reporter: Mageswaran
             Fix For: 1.6.0


Adding support for submitting PySpark based Sparks jobs (which is normally 
structured as modules) over Livy on existing "ExecuteSparkInteractive" 
processor.

This is done by reading file paths for pyfiles and file and an option from user 
whether the processor should trigger a batch job or not.

[https://livy.incubator.apache.org/docs/latest/rest-api.html]

 

More details will be posted in the Git link.

 

Thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to