[
https://issues.apache.org/jira/browse/HUDI-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1573:
-----------------------------
Component/s: Spark Integration
Writer Core
(was: Common Core)
> Spark Sql Writer support Multi preCmp Field
> -------------------------------------------
>
> Key: HUDI-1573
> URL: https://issues.apache.org/jira/browse/HUDI-1573
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Spark Integration, Writer Core
> Reporter: ann
> Priority: Minor
> Labels: pull-request-available
>
> HoodieSparkSqlWriter has a param PRECOMBINE_FIELD_OPT_KEY , which specify a
> nested field.
> Now, support getMultiNestedFieldVal process. If PRECOMBINE_FIELD_OPT_KEY has
> seperator ',' , thus multi nested fields to be compared , to solve
> duplicated input records before tag.
> Example : `timestamp`, `gtid` in binlog source .
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
