Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19294
@szhem You are correct, currently it fails in the driver itself.
So failures in executor are not seen - since job submission fails.
With this pr, the job submission should succeed - but the subsequent
execution in sql could fail (since sql uses some of the methods which have not
been patched in this PR if I am not wrong - newTaskTempFileAbsPath,
newTaskTempFile, etc).
A testcase to validate that would clarify things.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
