Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18537
Sorry for leaving multiple comments but @heary-cao, I just want to be very
sure.
Is the issue that the directory is not deleted when properly tested from
end to end or is it only `spark.local.dir` not properly set as intended?
I guess we will create another different temp directory after
`Utils.clearLocalRootDirs()` but it looks we add all of them into shutdown
hooker. I guess the latter should be fixed in any event but the issue in the
JIRA sounds describing the former.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
