[
https://issues.apache.org/jira/browse/SPARK-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15780014#comment-15780014
]
Jared commented on SPARK-15359:
-------------------------------
Hi, I also met some similar problem when running spark on mesos.
For my testing, spark mesos dispatcher didn't register with mesos master
successfully. But mesos dispatcher is still brought up and listening on default
port 7077.
I think mesos dispatcher should been shut down if status of mesosDriver.run()
is DRIVER_ABORTED.
I didn't quite understand content in the description. What's meaning of
"successful registration"? Do you mean mesosDriver.run() return without
aborting?
If we're working exactly on the same problem, I would like to contribute to fix
this issue, for example, review code changes or testing the fixes and so on.
Thanks,
Jared
> Mesos dispatcher should handle DRIVER_ABORTED status from mesosDriver.run()
> ---------------------------------------------------------------------------
>
> Key: SPARK-15359
> URL: https://issues.apache.org/jira/browse/SPARK-15359
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Mesos
> Reporter: Devaraj K
> Priority: Minor
>
> Mesos dispatcher handles DRIVER_ABORTED status for mesosDriver.run() during
> the successful registration but if the mesosDriver.run() returns
> DRIVER_ABORTED status after the successful register then there is no action
> for the status and the thread will be terminated.
> I think we need to throw the exception and shutdown the dispatcher.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
