Re: [Mesos] How to Disable Blacklisting on Mesos?

2018-04-09 Thread Susan X. Huynh
Hi Han, You may be seeing the same issue I described here: https://issues.apache.org/jira/browse/SPARK-22342?focusedCommentId=16411780&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16411780 Do you see "TASK_LOST" in your driver logs? I got past that issue by updat

[Mesos] How to Disable Blacklisting on Mesos?

2018-04-08 Thread hantuzun
Hi all, Spark currently has blacklisting enabled on Mesos, no matter what: [SPARK-19755][Mesos] Blacklist is always active for MesosCoarseGrainedSchedulerBackend Blacklisting also prevents new drivers from running on our nodes where previous drivers' had failed tasks. We've tried restarting Spar