[
https://issues.apache.org/jira/browse/SYSTEMML-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425815#comment-16425815
]
Niketan Pansare edited comment on SYSTEMML-1092 at 4/4/18 4:43 PM:
-------------------------------------------------------------------
Subtasks for this JIRAs are:
# Investigate whether it is possible to package pyspark dependencies into our
maven test suite without spark installation.
# If not, then come-up with simplest spark installation:
## Download spark and set SPARK_HOME
## Add pyspark as pip dependency
# Enable tests
[https://github.com/apache/systemml/blob/master/src/test/java/org/apache/sysml/test/integration/functions/python/PythonTestRunner.java#L41]
For reference, I believe PySpark test suite is kicked using the shell script:
[https://github.com/apache/spark/blob/master/dev/run-tests-jenkins]
was (Author: niketanpansare):
Before closing this issue, one needs to investigate whether it is possible to
package pyspark dependencies into our maven test suite. If not, the following
solution needs to be discussed in the mailing list before adding SPARK_HOME
requirement
- The Python tests are currently disabled as it requires the environment
variable SPARK_HOME to be set:
https://github.com/apache/systemml/blob/master/src/test/java/org/apache/sysml/test/integration/functions/python/PythonTestRunner.java#L41
- For reference, I believe PySpark test suite is kicked using the shell script:
https://github.com/apache/spark/blob/master/dev/run-tests-jenkins
> Integrate python test cases into junit test case
> ------------------------------------------------
>
> Key: SYSTEMML-1092
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1092
> Project: SystemML
> Issue Type: Task
> Reporter: Niketan Pansare
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
