[
https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948160#comment-16948160
]
Xianyin Xin commented on SPARK-28303:
-------------------------------------
[~echangzhang] Thank you for sharing your work with me. Seems our goals are
similar but not exactly the same, and the approaches are different. In fact
this ticket plans to add DELETE/UPDATE/MERGE support in Datasource V2, which
can be implemented by the concrete datasource, like file based sources(parquet
for example), kudu, and JDBC.
Does this meets your requirement?
> Support DELETE/UPDATE/MERGE Operations in DataSource V2
> -------------------------------------------------------
>
> Key: SPARK-28303
> URL: https://issues.apache.org/jira/browse/SPARK-28303
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Xianyin Xin
> Priority: Major
>
> Now many datasources (delta, jdbc, hive with transaction support, kudu, etc)
> supports deleting/updating data. It's necessary to add related APIs in the
> datasource V2 API sets.
> For example, we suggest add the below interface in V2 API,
> {code:java|title=SupportsDelete.java|borderStyle=solid}
> public interface SupportsDelete {
> WriteBuilder delete(Filter[] filters);
> }
> {code}
> which can delete data by simple predicates (complicated cases like correlated
> subquery is not considered currently).
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
