Chovan Zoltan created KUDU-3829:
-----------------------------------
Summary: Migrate to Spark DSv2
Key: KUDU-3829
URL: https://issues.apache.org/jira/browse/KUDU-3829
Project: Kudu
Issue Type: New Feature
Reporter: Chovan Zoltan
Assignee: Chovan Zoltan
Move the Kudu Spark connector from DSv1 to the DSv2 connector API on Spark 3.5
and 4.1.
Keep {{{}.format("kudu"){}}}, the existing options and the {{KuduContext}} API
unchanged.
Goals:
* {{LIMIT}} pushdown.
* Fewer row conversions.
* Spark UI metrics.
* An opt-in catalog.
* Eventually, row-level operations.
V1 stays in place for persisted {{USING kudu}} tables and for fallback.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)