[
https://issues.apache.org/jira/browse/HUDI-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001835#comment-17001835
]
sivabalan narayanan commented on HUDI-377:
------------------------------------------
[~vinoth] [~vbalaji]
A suggestion as an enhancement for delete support in delta streamer (not going
to make any changes to existing patch as part of this suggestion)
Can we add a field called "delete_marker_key" whose value will be a string and
will refer to the field in the record for delete marker key.
For eg:
update record w/o optional delete_marker_key
\{{"name","abc"},\{"age","25"},\{"gender","male"}}
update record w/
optional_delete_marker_key\{{"name","abc"},\{"age","25"},\{"gender","male"},\{"delete_marker_key","is_deleted"},\{"is_deleted","false"}}
delete record
\{{"name","abc"},\{"age","25"},\{"gender","male"},\{"delete_marker_key","is_deleted"},\{"is_deleted","true"}}
Not sure if I might encounter issues w/ optional fields that I encountered
while working on this patch.
> Add Delete() support to HoodieDeltaStreamer
> -------------------------------------------
>
> Key: HUDI-377
> URL: https://issues.apache.org/jira/browse/HUDI-377
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: deltastreamer
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Original Estimate: 72h
> Time Spent: 10m
> Remaining Estimate: 71h 50m
>
> Add Delete() support to HoodieDeltaStreamer
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
