Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21490
(sorry, I've been busy with Spark Summit)
The problem I see is that fault tolerance might not be cleanly separable
from query stop tolerance. If a user stops the query at the wrong time, will
they see strange results which make them think Spark is doing something wrong?
If we can come up with a clean story for what users will see on restart,
and it makes sense no matter when the query was stopped, I agree that this
change or #20958 would be reasonable to add.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
