Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-10 Thread via GitHub
codope closed issue #9831: [SUPPORT] Clarify the Multi Writer guarantee for duplicates URL: https://github.com/apache/hudi/issues/9831 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-10 Thread via GitHub
ad1happy2go commented on issue #9831: URL: https://github.com/apache/hudi/issues/9831#issuecomment-1754818455 Thanks for the feedback @istreeter . I agree, we will have more clarification on the website. JIRA created to track the doc change for 0.14.1 -

Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-10 Thread via GitHub
istreeter commented on issue #9831: URL: https://github.com/apache/hudi/issues/9831#issuecomment-1754600158 Thank you, the FAQ is helpful for explaining ways to work with the problem. I think the summary of this conversation is that duplicates happen even if

Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-09 Thread via GitHub
xicm commented on issue #9831: URL: https://github.com/apache/hudi/issues/9831#issuecomment-1754203688 https://hudi.apache.org/docs/faq/#can-concurrent-inserts-cause-duplicates -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-09 Thread via GitHub
istreeter commented on issue #9831: URL: https://github.com/apache/hudi/issues/9831#issuecomment-1752826301 Thank you @xicm for sharing the link to RFC-66. This was enlightening for how the problem will be addressed in future. But for now keeping the conversation about the current

Re: [I] [SUPPORT] Clarify the Multi Writer guarantee for duplicates [hudi]

2023-10-09 Thread via GitHub
xicm commented on issue #9831: URL: https://github.com/apache/hudi/issues/9831#issuecomment-1752426819 The problem you described is correct and multi-writer does have this problem now. Danny is working for a Non blocking concurrency control https://github.com/apache/hudi/pull/7907 --