Chovan Zoltan created KUDU-3829:
-----------------------------------

             Summary: Migrate to Spark DSv2
                 Key: KUDU-3829
                 URL: https://issues.apache.org/jira/browse/KUDU-3829
             Project: Kudu
          Issue Type: New Feature
            Reporter: Chovan Zoltan
            Assignee: Chovan Zoltan


Move the Kudu Spark connector from DSv1 to the DSv2 connector API on Spark 3.5 
and 4.1. 

Keep {{{}.format("kudu"){}}}, the existing options and the {{KuduContext}} API 
unchanged.

Goals:
 * {{LIMIT}} pushdown.
 * Fewer row conversions.
 * Spark UI metrics.
 * An opt-in catalog.
 * Eventually, row-level operations.

V1 stays in place for persisted {{USING kudu}} tables and for fallback.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to