Github user rvesse commented on the issue:
https://github.com/apache/spark/pull/22256
@skonto I haven't done anything specific for the size limit ATM. From the
K8S docs `tmpfs` backed `emptyDir` usage counts towards your containers memory
limits so you can just set `spark.executor.memory` to a larger amount as needed.
From the discussion you linked you can explicitly set a size limit for the
volume but I wanted to avoid adding multiple configuration options if possible.
Since this PR allows for template defined volumes to be used you could define
a volume in your template with the `sizeLimit` applied to it once you have pod
templates PR available
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
