Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20386
`FileCommitProtocol.onTaskCommit` is called in `FileFormatWriter.write`, so
this PR is required to migrate file-based data sources.
By a quick look, it seems `FileCommitProtocol.onTaskCommit` doesn't have an
implementation yet, but I don't want to change the existing API and I assume
this API is necessary. BTW it sounds reasonable to provide a callback for task
commit.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
