mingmwang commented on issue #602: URL: https://github.com/apache/arrow-ballista/issues/602#issuecomment-1423508903
There is one exception, the finally query results are also some kind of shuffle files, we can not delete those shuffle files after the job finishes. I think we need a way to differ the shuffle files generated by the intermediate stages and the final result stage. @thinkharderdev @yahoNanJing Do you have some idea ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
