[GitHub] spark pull request: remove staging dir when app quiting for yarn-c...

2014-03-16 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/154#issuecomment-37751154 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: remove staging dir when app quiting for yarn-c...

2014-03-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/154#issuecomment-37750476 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: remove staging dir when app quiting for yarn-c...

2014-03-15 Thread gzm55
GitHub user gzm55 opened a pull request: https://github.com/apache/spark/pull/154 remove staging dir when app quiting for yarn-cluster mode In yarn-cluster, the driver is actually running as 'yarn' user. When posting jobs from other users, we need give stagingDir a full path, so