Apache Spark commented on SPARK-23323:

User 'rdblue' has created a pull request for this issue:

> DataSourceV2 should use the output commit coordinator.
> ------------------------------------------------------
>                 Key: SPARK-23323
>                 URL: https://issues.apache.org/jira/browse/SPARK-23323
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Ryan Blue
>            Priority: Major
> DataSourceV2 writes should use the output commit coordinator to guarantee 
> only one tasks successfully commits.
> Not all sources will need coordination, so I propose adding 
> {{coordinateCommits: boolean}} to the {{DataWriterFactory}}.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to