Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/6026#issuecomment-100464036
To be more specific, you are pointing out that the staging dir is set up
before the AM runs. The AM also does this cleanup, but if it fails to start,
nothing cleans this up.
I agree, but this it a band-aid that doesn't catch most error cases and
would still leave this dir lying around.
Can the staging files be set up much later in this initialization? that
would greatly narrow the problem
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
