[
https://issues.apache.org/jira/browse/HUDI-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jian Feng updated HUDI-3304:
----------------------------
Description:
h2. current status
* OverwriteNonDefaultsWithLatestAvroPayload implement partial update behavior
in combineAndGetUpdateValue method
* Spark sql also have a 'Merge into' syntax support partial update by
ExpressionPayload,
* both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can not
handle partial update in preCombine method, so they can only support partial
update with COW table
h2. solution
make preCombine function also support partial update(need pass schema as
parameter)
!image2022-1-13_0-33-5.png|width=832,height=516!
was:
h2. current status
* OverwriteNonDefaultsWithLatestAvroPayload implement partial update behavior
in combineAndGetUpdateValue method
* Spark sql also have a 'Merge into' syntax support partial update by
ExpressionPayload,
* both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can not
handle partial update in preCombine method, so they can only support partial
update with COW table
h2. solution
make preCombine function also support partial update
!image2022-1-13_0-33-5.png|width=832,height=516!
> support partial update on mor table
> ------------------------------------
>
> Key: HUDI-3304
> URL: https://issues.apache.org/jira/browse/HUDI-3304
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Jian Feng
> Assignee: Jian Feng
> Priority: Major
> Attachments: image2022-1-13_0-33-5.png
>
>
> h2. current status
> * OverwriteNonDefaultsWithLatestAvroPayload implement partial update
> behavior in combineAndGetUpdateValue method
> * Spark sql also have a 'Merge into' syntax support partial update by
> ExpressionPayload,
> * both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can
> not handle partial update in preCombine method, so they can only support
> partial update with COW table
> h2. solution
> make preCombine function also support partial update(need pass schema as
> parameter)
> !image2022-1-13_0-33-5.png|width=832,height=516!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
