Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20386
> I assume this API is necessary . . . it sounds reasonable to provide a
callback for task commit.
I agree it sounds reasonable, but we shouldn't add methods to a new API
blindly and without a use case. The point of a new API, at least in part, is to
improve on the old one. If it is never used, then we are carrying support for
something that is useless. On the other hand, if it is used we should know what
it is needed for so we can design for the use case.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
