Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21589#discussion_r198174777
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosFineGrainedSchedulerBackend.scala
---
@@ -446,6 +446,8 @@ private[spark] class MesosFineGrainedSchedulerBackend(
// TODO: query Mesos for number of cores
override def defaultParallelism(): Int =
sc.conf.getInt("spark.default.parallelism", 8)
+ override def numCores(): Int = defaultParallelism
+ override def numExecutors(): Int = 1
--- End diff --
The mode (and the file) is going to be removed in Spark 3.0:
https://github.com/apache/spark/pull/18784
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
