Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143819718
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -237,6 +246,43 @@ class BlockManagerMasterEndpoint(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143816789
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -76,6 +76,14 @@ package object config {
.timeConf(TimeUnit.MILLI
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143818189
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -97,6 +97,10 @@ class BlockManagerMasterEndpoint(
ca
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143802914
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143811908
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143807978
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143811393
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143816598
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +423,52 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143810176
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143813871
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143814023
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143817365
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -646,18 +648,14 @@ class CoarseGrainedSchedulerB
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143817162
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -601,40 +602,41 @@ class CoarseGrainedSchedulerB
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143816092
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143819863
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -237,6 +246,43 @@ class BlockManagerMasterEndpoint(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143818025
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -698,6 +696,11 @@ class CoarseGrainedSchedulerBa
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143802830
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143803799
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143799387
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143801381
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143816714
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -76,6 +76,14 @@ package object config {
.timeConf(TimeUnit.MILLI
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143815711
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +423,52 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143799104
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r143800553
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,250 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r142478432
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -120,6 +124,10 @@ class BlockManagerMasterEndpoint(
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r142199422
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -88,6 +89,12 @@ class CoarseGrainedSchedule
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r140841617
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139223468
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala ---
@@ -116,4 +121,11 @@ private[spark] object BlockManagerMessages {
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139223492
--- Diff: docs/configuration.md ---
@@ -1705,6 +1705,26 @@ Apart from these, the following properties are also
available, and may be useful
des
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139223409
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala ---
@@ -32,8 +32,13 @@ private[spark] object BlockManagerMessages {
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139223321
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -1231,6 +1231,7 @@ private[spark] class BlockManager(
def replic
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139223199
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -612,25 +623,26 @@ class CoarseGrainedSched
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139172781
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005849
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -314,6 +314,7 @@ private[spark] class TaskSchedulerImpl(
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005783
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005809
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005738
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005649
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139005697
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139004878
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139004913
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139004286
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r139004156
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138935220
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +424,52 @@ private[spark] class ExecutorAllocationManager(
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138935176
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +424,52 @@ private[spark] class ExecutorAllocationManager(
Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138934898
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -108,6 +110,10 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138761246
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -120,6 +124,10 @@ class BlockManagerMasterEndpoint(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138760176
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138760634
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -88,6 +89,12 @@ class CoarseGrainedSchedulerBack
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138758096
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138755830
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138761473
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala ---
@@ -116,4 +121,11 @@ private[spark] object BlockManagerMessages {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138757166
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138761778
--- Diff: docs/configuration.md ---
@@ -1705,6 +1705,26 @@ Apart from these, the following properties are also
available, and may be useful
descript
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138760879
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -1231,6 +1231,7 @@ private[spark] class BlockManager(
def replicateBl
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138756115
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138758727
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138754158
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +424,52 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138757437
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138753970
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -108,6 +110,10 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138755966
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138760714
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -612,25 +623,26 @@ class CoarseGrainedSchedulerB
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138760403
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -314,6 +314,7 @@ private[spark] class TaskSchedulerImpl(
def r
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138761658
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala ---
@@ -32,8 +32,13 @@ private[spark] object BlockManagerMessages {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138754738
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138754518
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -416,63 +424,52 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r138756535
--- Diff: core/src/main/scala/org/apache/spark/RecoverCacheShutdown.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed to the Apache Software Foundation (A
201 - 267 of 267 matches
Mail list logo