[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-10-09 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-705886913 > Can you give an example about the temp directory structure? Here is one example for this. ``` .hive-staging_hive_2020-10-09_07-47-28_023_8877681090053776592-1/

[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-10-08 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-705886913 > Can you give an example about the temp directory structure? Here is one example for this. ``` .hive-staging_hive_2020-10-09_07-47-28_023_8877681090053776592-1/

[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-09-29 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-700645391 > is it possible that a task knows it fails to commit and clean up the files? Em, I have thought about this. This is a good way to remove extra output file and can also

[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-09-29 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-700496802 > Can you give more details about the use cases? There might be better ways to solve it. @cloud-fan Thanks for your reply. Actually, this have been discussed in #28129.

[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-07-14 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-658243169 kindly remind @rdblue @cloud-fan @xuanyuanking. This is an automated message from the Apache Git Service. To

[GitHub] [spark] stczwd commented on pull request #28280: [SPARK-31438][CORE][SQL] Support JobCleaned Status in SparkListener

2020-05-05 Thread GitBox
stczwd commented on pull request #28280: URL: https://github.com/apache/spark/pull/28280#issuecomment-624416684 cc @rdblue @cloud-fan @xuanyuanking This is an automated message from the Apache Git Service. To respond to the