Github user brad-kaiser commented on a diff in the pull request:
https://github.com/apache/spark/pull/19836#discussion_r153686556
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -159,11 +160,18 @@ class BlockManagerMasterEndpoint(
// Ask the slaves to remove the RDD, and put the result in a sequence
of Futures.
// The dispatcher is used as an implicit argument into the Future
sequence construction.
val removeMsg = RemoveRdd(rddId)
- Future.sequence(
- blockManagerInfo.values.map { bm =>
- bm.slaveEndpoint.ask[Int](removeMsg)
- }.toSeq
- )
+
+ val handleRemoveRddException: PartialFunction[Throwable, Int] = {
+ case e: IOException =>
+ logError(s"Error trying to remove rdd $rddId", e)
--- End diff --
Thanks for looking at my change. I changed the log to warning and "rdd" to
"RDD". I had pulled out the partial function out because I felt like the
expression was getting too deeply nested and hard to read. I certainly don't
have to do that though.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
