viirya commented on pull request #32702: URL: https://github.com/apache/spark/pull/32702#issuecomment-851067116
> What's the solution of this? Doesn't it mean you want to make the directory be writable from multiple queries? The use-case looks like this. The user wants to write to same output directory. But once they change something in the query and previous checkpoint cannot be used anymore, they need to use a new checkpoint directory (and metadata directory). They don't write to the output from multiple queries at the same time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
