Github user mridulm commented on the issue: https://github.com/apache/spark/pull/19294 @szhem You are correct, currently it fails in the driver itself. So failures in executor are not seen - since job submission fails. With this pr, the job submission should succeed - but the subsequent execution in sql could fail (since sql uses some of the methods which have not been patched in this PR if I am not wrong - newTaskTempFileAbsPath, newTaskTempFile, etc). A testcase to validate that would clarify things.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org