[
https://issues.apache.org/jira/browse/OOZIE-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458304#comment-15458304
]
Peter Cseh edited comment on OOZIE-2554 at 9/2/16 11:49 AM:
------------------------------------------------------------
We could do something similar we're doing in
[JavaActionExecutor.getLauncherClasses|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java#L158].
The {{main}} function would be called using reflection or by defining to wrap
SparkMain.
There could be a property like {{oozie.action.spark.main.class}} with default
value {{org.apache.spark.SparkMain}} and we would replace SparkMain with a
validator during tests.
This way we won't call Spark in the tests (at least not in all of them), but we
could test out that SparkMain handles the properties as it should.
was (Author: gezapeti):
We could do something similar we're doing in
[JavaActionExecutor.getLauncherClasses|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java#L158].
The {{main}} function would be called using reflection or by defining to wrap
SparkMain.
There could be a property like {{oozie.action.spark.main.class}} with default
value {{org.apache.spark.SparkMain}} and we would replace SparkMain with a
validator during tests.
This way we won't call Spark in the tests, but we could test out that SparkMain
handles the properties as it should.
> Spark action tests on yarn-cluster, yarn-client mode
> ----------------------------------------------------
>
> Key: OOZIE-2554
> URL: https://issues.apache.org/jira/browse/OOZIE-2554
> Project: Oozie
> Issue Type: New Feature
> Reporter: Satish Subhashrao Saley
>
> Currently, we have unit test cases for Spark Action in local mode. To verify
> other functionality, we should have tests in yarn-cluster and yarn-client
> mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
