Ryan Blue created SPARK-23323:

             Summary: DataSourceV2 should use the output commit coordinator.
                 Key: SPARK-23323
                 URL: https://issues.apache.org/jira/browse/SPARK-23323
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Ryan Blue

DataSourceV2 writes should use the output commit coordinator to guarantee only 
one tasks successfully commits.

Not all sources will need coordination, so I propose adding 
{{coordinateCommits: boolean}} to the {{DataWriterFactory}}.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to