Hudi support for records deduplication

[Li Gao]

Hi Hudi community,

I am fairly new to the hudi community and trying to evaluate whether hudi's
incremental compaction support record deduplications from landing data
coming off kafka. If yes I want to understand how it works currently.

Thank you,
Li