Gengliang Wang created SPARK-60488:
--------------------------------------

             Summary: Rust SDK for native data sources
                 Key: SPARK-60488
                 URL: https://issues.apache.org/jira/browse/SPARK-60488
             Project: Spark
          Issue Type: Umbrella
          Components: SQL
    Affects Versions: 5.0.0
            Reporter: Gengliang Wang


Umbrella ticket for an experimental Rust SDK for native data sources built on 
the native data source C ABI (SPARK-60101). The SDK lets Rust connectors 
implement batch and micro-batch streaming reads, and batch and streaming 
writes, without manually managing C function tables, opaque handles, serialized 
messages, Arrow ownership, or task-context lifetimes. Initial PR: 
https://github.com/apache/spark/pull/59520



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to