holdenk commented on PR #40128: URL: https://github.com/apache/spark/pull/40128#issuecomment-1487537833
So as I think about it, what about if we did a cleanup as a script for the driver pod on terminate to address some of @dongjoon-hyun's concern? The TTL based approach feels fundamentally "better" though. Certainly it is filesystem specific, but I think (besides) HDFS all of the major filesystems we would use support TTL yes? Perhaps we should just document this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
