[GitHub] spark issue #19510: [SPARK-22292][Mesos] Added spark.mem.max support for Mes...

2017-10-31 Thread windkit
Github user windkit commented on the issue: https://github.com/apache/spark/pull/19510 @susanxhuynh Thanks for reviewing. I want to use both `spark.mem.max` and `spark.cores.max` to limit resource one task can use within the cluster. Now I am setting up a common cluster

[GitHub] spark pull request #19555: [SPARK-22133][DOCS] Documentation for Mesos Rejec...

2017-10-23 Thread windkit
Github user windkit commented on a diff in the pull request: https://github.com/apache/spark/pull/19555#discussion_r146273016 --- Diff: docs/running-on-mesos.md --- @@ -613,6 +621,41 @@ See the [configuration page](configuration.html) for information on Spark config

[GitHub] spark pull request #19555: [SPARK-22133][DOCS] Documentation for Mesos Rejec...

2017-10-23 Thread windkit
Github user windkit commented on a diff in the pull request: https://github.com/apache/spark/pull/19555#discussion_r146272841 --- Diff: docs/running-on-mesos.md --- @@ -196,17 +196,18 @@ configuration variables: * Executor memory: `spark.executor.memory` * Executor

[GitHub] spark pull request #19555: [SPARK-22133][DOCS] Documentation for Mesos Rejec...

2017-10-23 Thread windkit
Github user windkit commented on a diff in the pull request: https://github.com/apache/spark/pull/19555#discussion_r146272708 --- Diff: docs/running-on-mesos.md --- @@ -196,17 +196,18 @@ configuration variables: * Executor memory: `spark.executor.memory` * Executor

[GitHub] spark pull request #19510: [SPARK-22292][Mesos] Added spark.mem.max support ...

2017-10-23 Thread windkit
Github user windkit commented on a diff in the pull request: https://github.com/apache/spark/pull/19510#discussion_r146180171 --- Diff: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala --- @@ -64,6 +64,7

[GitHub] spark pull request #19555: [SPARK-22133][DOCS] Documentation for Mesos Rejec...

2017-10-23 Thread windkit
GitHub user windkit opened a pull request: https://github.com/apache/spark/pull/19555 [SPARK-22133][DOCS] Documentation for Mesos Reject Offer Configurations ## What changes were proposed in this pull request? Documentation about Mesos Reject Offer Configurations

[GitHub] spark issue #19510: [SPARK-22292][Mesos] Added spark.mem.max support for Mes...

2017-10-20 Thread windkit
Github user windkit commented on the issue: https://github.com/apache/spark/pull/19510 @skonto sure I can add those in, can you point to me where the documentation source code is? --- - To unsubscribe, e-mail

[GitHub] spark pull request #19510: [SPARK-22292][Mesos] Added spark.mem.max support ...

2017-10-20 Thread windkit
Github user windkit commented on a diff in the pull request: https://github.com/apache/spark/pull/19510#discussion_r145890559 --- Diff: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala --- @@ -64,6 +64,7

[GitHub] spark pull request #19510: [SPARK-22292][Mesos] Added spark.mem.max support ...

2017-10-17 Thread windkit
GitHub user windkit opened a pull request: https://github.com/apache/spark/pull/19510 [SPARK-22292][Mesos] Added spark.mem.max support for Mesos ## What changes were proposed in this pull request? To limit the amount of resources a spark job accept from Mesos, currently we