Iulian Dragos created SPARK-12265:
-------------------------------------

             Summary: Spark calls System.exit inside driver instead of throwing 
exception
                 Key: SPARK-12265
                 URL: https://issues.apache.org/jira/browse/SPARK-12265
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.6.0
            Reporter: Iulian Dragos


Spark may call {{System.exit}} if Mesos sends an error code back to the 
MesosSchedulerDriver. This makes Spark very hard to test, since this 
effectively kills the driver application under test. Such tests may run under 
ScalaTest, that doesn't get a chance to collect a result and populate a report.

Relevant code is in MesosSchedulerUtils.scala:

{code}
            val ret = mesosDriver.run()
            logInfo("driver.run() returned with code " + ret)
            if (ret != null && ret.equals(Status.DRIVER_ABORTED)) {
              System.exit(1)
            }
{code}

Errors should be signaled with a {{SparkException}} in the correct thread.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to