Github user rvesse commented on the issue:
https://github.com/apache/spark/pull/22256
@skonto Here is the PR for the `SPARK_LOCAL_DIRS` behaviour customisation
we were discussing in the context of SPARK-24434.
I have minimised config to adding a single new setting for the simple case
of just wanting to use `tmpfs` for the local storage and relied upon the
forthcoming pod templates functionality to allow deeper customisation.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
