nsivabalan edited a comment on issue #2255: URL: https://github.com/apache/hudi/issues/2255#issuecomment-775977895
@WTa-hash : I tried to reproduce this w/ quick start utils. I couldn't see the duplicates. But I could reproduce with the test script you gave me just w/ my local spark-shell. So, something to do specifically w/ your use-case(key gen or some config setting). I need to spend more time to find the issue. quick start: https://gist.github.com/nsivabalan/a0b8345f3675c6db431045c511052cfb your test data in local https://gist.github.com/nsivabalan/1aaf0bfca044b0413f951d941bb8d801 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
