jmnatzaganian commented on issue #10650: URL: https://github.com/apache/hudi/issues/10650#issuecomment-1954799508
Despite the initial report being with `upsert`, I can confirm that the new `hoodie.datasource.insert.dup.policy` option does not drop dupes as expected with the `insert` write operation. The deprecated fields work as desired. I have a small example [hudi_insert_no_dupes.py](https://github.com/apache/hudi/files/14349574/hudi_insert_no_dupes.py.txt) demonstrating the behavior. In the interim, I will be using the deprecated fields as a workaround. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
