Github user Mageswaran1989 commented on a diff in the pull request:
https://github.com/apache/nifi/pull/2521#discussion_r173349052
--- Diff:
nifi-nar-bundles/nifi-spark-bundle/nifi-livy-processors/src/main/java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java
---
@@ -83,6 +83,62 @@
.expressionLanguageSupported(true)
.build();
+ public static final PropertyDescriptor IS_BATCH_JOB = new
PropertyDescriptor.Builder()
+ .name("exec-spark-iactive-is_batch_job")
+ .displayName("Is Batch Job")
+ .description("If true, the `Code` part is ignored and the flow
file from previous stage is considered "
+ + "as a triggering event and not as code for Spark
session. When `Wait` state is self routed"
+ + "the livy json response flow file from previous
Spark job is used to poll the job status"
+ + "for sucess or failure")
+ .required(true)
+ .allowableValues("true", "false")
+ .defaultValue("false")
+ .build();
+
+ public static final PropertyDescriptor PY_FILES = new
PropertyDescriptor.Builder()
+ .name("exec-spark-iactive-pyfiles")
+ .displayName("pyFiles")
+ .description("Python files to be used in this batch session
that includes *.py, *.zip files")
+ .required(false)
+ .addValidator(StandardValidators.createURLorFileValidator())
+ .expressionLanguageSupported(false)
+ .build();
+
+ public static final PropertyDescriptor JAR_FILES = new
PropertyDescriptor.Builder()
+ .name("exec-spark-iactive-jarfiles")
+ .displayName("jars")
+ .description("jars to be used in this batch session")
+ .required(false)
+ .addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+ .expressionLanguageSupported(false)
+ .build();
+
+ public static final PropertyDescriptor NAME = new
PropertyDescriptor.Builder()
--- End diff --
Like said before, not yet considered. We just wanted to get a hang of the
code with our basic requirements
---
