Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/607#issuecomment-41909084
I had thought about this more last night and I agree with Sandy, unless
there is a case we launch tasks as different users we should look at moving
the doAs up and possibly for the entire executor. Doing it per task is less
efficient and if running on spark on yarn with security on is purely overhead
anyway. That should also help with actually sharing the filesystem more. The
downside to sharing that is you have to make sure one task doesn't close it on
another task whereas now this is actually providing you a bit of isolation.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
