[
https://issues.apache.org/jira/browse/SPARK-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786813#comment-15786813
]
Jared commented on SPARK-15359:
-------------------------------
Hi, I tested the fix. However, it seemed the problem still existed.
I1230 11:39:07.096375 6889 sched.cpp:1223] Aborting framework
16/12/30 11:39:07 INFO MesosClusterScheduler: driver.run() returned with code
DRIVER_ABORTED
16/12/30 11:39:07 ERROR MesosClusterScheduler: driver.run() failed
org.apache.spark.SparkException: Error starting driver, DRIVER_ABORTED
at
org.apache.spark.scheduler.cluster.mesos.MesosSchedulerUtils$$anon$1.run(MesosSchedulerUtils.scala:124)
Exception in thread "MesosClusterScheduler-mesos-driver"
org.apache.spark.SparkException: Error starting driver, DRIVER_ABORTED
at
org.apache.spark.scheduler.cluster.mesos.MesosSchedulerUtils$$anon$1.run(MesosSchedulerUtils.scala:124)
16/12/30 11:39:07 INFO Utils: Successfully started service on port 7077.
16/12/30 11:39:07 INFO MesosRestServer: Started REST server for submitting
applications on port 7077
It seemed that exceptions thrown was not handled.
I think several other files should also be changed to fix this problem.
> Mesos dispatcher should handle DRIVER_ABORTED status from mesosDriver.run()
> ---------------------------------------------------------------------------
>
> Key: SPARK-15359
> URL: https://issues.apache.org/jira/browse/SPARK-15359
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Mesos
> Reporter: Devaraj K
> Priority: Minor
>
> Mesos dispatcher handles DRIVER_ABORTED status for mesosDriver.run() during
> the successful registration but if the mesosDriver.run() returns
> DRIVER_ABORTED status after the successful register then there is no action
> for the status and the thread will be terminated.
> I think we need to throw the exception and shutdown the dispatcher.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
