rangareddy commented on issue #14582: URL: https://github.com/apache/hudi/issues/14582#issuecomment-4911999914
This issue was reviewed as part of the JIRA-migrated backlog triage. Findings: This appears to be fixed on current master in hudi-client-common .../index/bucket/HoodieSimpleBucketIndex.java (loadBucketIdToFileIdMappingForPartition, ~lines 68-84). The Spark-side bucketId->fileId mapping now iterates the latest file slices including log-only slices (HoodieIndexUtils.getLatestFileSlicesForPartition), so Flink-written log-only buckets are recognized instead of triggering a new inconsistent bucket, and genuine duplicate bucket ids now throw with a rollback hint. The originally linked PRs #6593/#6595 were closed unmerged, and #5185 (HUDI-3758) addressed only a similar earlier case. If you're still hitting this on a recent version, please reopen with repro steps. Closing as fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
