Gengliang Wang created SPARK-61907:
--------------------------------------

             Summary: Support row-level operations and metadata columns for 
native data sources
                 Key: SPARK-61907
                 URL: https://issues.apache.org/jira/browse/SPARK-61907
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 5.0.0
            Reporter: Gengliang Wang


Native data sources support batch and streaming appends and truncating 
overwrites, but neither row-level operations, {{DELETE}}, {{UPDATE}} and 
{{MERGE INTO}} ({{SupportsRowLevelOperations}}), nor metadata columns 
({{SupportsMetadataColumns}}), such as the file and the position of a row, 
which row-level operations build on.

Proposal: add metadata columns, and then row-level operations, to the native 
data source interface ({{spark_datasource.h}}) within version 1, for the data 
sources that declare a capability for them, and expose them in the Rust SDK 
(SPARK-61282).




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to