Gengliang Wang created SPARK-61907:
--------------------------------------
Summary: Support row-level operations and metadata columns for
native data sources
Key: SPARK-61907
URL: https://issues.apache.org/jira/browse/SPARK-61907
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 5.0.0
Reporter: Gengliang Wang
Native data sources support batch and streaming appends and truncating
overwrites, but neither row-level operations, {{DELETE}}, {{UPDATE}} and
{{MERGE INTO}} ({{SupportsRowLevelOperations}}), nor metadata columns
({{SupportsMetadataColumns}}), such as the file and the position of a row,
which row-level operations build on.
Proposal: add metadata columns, and then row-level operations, to the native
data source interface ({{spark_datasource.h}}) within version 1, for the data
sources that declare a capability for them, and expose them in the Rust SDK
(SPARK-61282).
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]