TengHuo commented on PR #6406: URL: https://github.com/apache/hudi/pull/6406#issuecomment-1323145937
Got it, thanks @danny0405 . I just reviewed the code about Hudi index and bloom filter recently. Indeed, it is useless in Flink pipeline, because index in Flink pipeline is decided by operator (BucketAssignFunction or BucketStreamWriteOperator), other index won't work in Hudi Flink pipeline. Thus, there are only 2 index work in Hudi Flink: "FLINK_STATE" and "BUCKET" for now (0.12.1). Bloom filter in Hudi Flink is not for index lookup during writing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
