Mageswaran created NIFI-4946: -------------------------------- Summary: nifi-spark-bundle : Adding support for pyfiles, file, jars options Key: NIFI-4946 URL: https://issues.apache.org/jira/browse/NIFI-4946 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 1.6.0 Environment: Ubuntu 16.04, IntelliJ Reporter: Mageswaran Fix For: 1.6.0
Adding support for submitting PySpark based Sparks jobs (which is normally structured as modules) over Livy on existing "ExecuteSparkInteractive" processor. This is done by reading file paths for pyfiles and file and an option from user whether the processor should trigger a batch job or not. [https://livy.incubator.apache.org/docs/latest/rest-api.html] More details will be posted in the Git link. Thanks. -- This message was sent by Atlassian JIRA (v7.6.3#76005)