GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/2826
Remove duplicate removal of local dirs The shutdown hook of `DiskBlockManager` would remove localDirs. So do not need to register them with `Utils.registerShutdownDeleteDir`. It causes duplicate removal of these local dirs and corresponding exceptions. You can merge this pull request into a Git repository by running: $ git pull https://github.com/viirya/spark-1 fix_duplicate_localdir_remove Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/2826.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2826 ---- commit 2b91a9c6e93c1dec90ee079558cb3a291e3065de Author: Liang-Chi Hsieh <vii...@gmail.com> Date: 2014-10-16T15:17:38Z remove duplicate removal of local dirs. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org