Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21589#discussion_r197107564
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosFineGrainedSchedulerBackend.scala
---
@@ -446,6 +446,8 @@ private[spark] class MesosFineGrainedSchedulerBackend(
// TODO: query Mesos for number of cores
override def defaultParallelism(): Int =
sc.conf.getInt("spark.default.parallelism", 8)
+ override def numCores(): Int = defaultParallelism
+ override def numExecutors(): Int = 1
--- End diff --
Eh, is it simply because it's not implemented yet in Mesos? I am not used
to it but I thought it's better be mentioned somewhere.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
