Github user gpang commented on the issue:
https://github.com/apache/spark/pull/18098
Hi @srowen @vanzin , would you be able to help me with this PR? Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user gpang commented on the issue:
https://github.com/apache/spark/pull/18098
@srowen @vanzin Could you help me get this PR merged? Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user gpang commented on the issue:
https://github.com/apache/spark/pull/18098
@mgummelt @lins05 @skonto The tests passed with SparkQA, but something on
AppVeyor failed. The AppVeyor output also shows the tests pass but it timed out
with something. Do you know how to re-trigger
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r129095888
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -72,6 +72,10 @@ package object config {
private[spark] val
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r122734471
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -502,6 +526,23
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r122734516
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -502,6 +526,23
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r122734414
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -291,6 +300,19
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r122734682
--- Diff:
resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala
---
@@ -586,6
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r122734548
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -502,6 +526,23
Github user gpang commented on the issue:
https://github.com/apache/spark/pull/18098
I refactored the code a bit. I also update the wait start time when the
request is updated. That will reset the wait time and try for locality. This
should handle the case you mentioned when
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r120231509
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -502,6 +521,25
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r118590493
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -502,6 +521,25
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r118581450
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -393,7 +410,30
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r118581400
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -393,7 +409,30
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r118529407
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -393,7 +409,30
Github user gpang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18098#discussion_r118528485
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -94,6 +94,14
GitHub user gpang opened a pull request:
https://github.com/apache/spark/pull/18098
[SPARK-16944][Mesos] Improve data locality when launching new executors
when dynamic allocation is enabled
## What changes were proposed in this pull request?
Improve the Spark-Mesos coarse
17 matches
Mail list logo
