Vinoth Chandar created HUDI-2809:
------------------------------------
Summary: Introduce a checksum mechanism for validating
hoodie.properties
Key: HUDI-2809
URL: https://issues.apache.org/jira/browse/HUDI-2809
Project: Apache Hudi
Issue Type: Improvement
Components: Writer Core
Reporter: Vinoth Chandar
Assignee: Vinoth Chandar
Fix For: 0.10.0
Idea here is to add a
{_}hoodie.checksum=<hash_of_table_name{_}>
entry as the last value of hoodie.properties and throw an error if it does not
validate. this is to guard partial writes on HDFS
Main implementation issue is use of Properties which is a hashtable, so the
entry is not added as the last value necessarily.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
