jose-torres commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-467675211 I guess my major quesiton is the user-facing motivation for this - why do Spark users want to use these options? Is it just a matter of controlling storage space without an offline janitor? (This may be obvious - I just want to make sure we aren't overlooking some simpler way to accomplish the end goal.) There have also been a lot of comments discussed without unit tests written to confirm we've resolved the issue.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
