nfarah86 commented on code in PR #10658: URL: https://github.com/apache/hudi/pull/10658#discussion_r1503411628
########## website/docs/indexing.md: ########## @@ -27,27 +27,19 @@ could end up having to merge all the base files against all incoming updates/del Currently, Hudi supports the following index types. Default is SIMPLE on Spark engine, and INMEMORY on Flink and Java engines. -- **BLOOM:** Employs bloom filters built out of the record keys, optionally also pruning candidate files using - record key ranges.Key uniqueness is enforced inside partitions. -- **GLOBAL_BLOOM:** Employs bloom filters built out of the record keys, optionally also pruning candidate files using - record key ranges. Key uniqueness is enforced across all partitions in the table. -- **SIMPLE (default for Spark engines):** Default index type for spark engine. Performs a lean join of the incoming records against keys extracted from the table on - storage. Key uniqueness is enforced inside partitions. +- **BLOOM:** Uses bloom filters generated from record keys, with the option to further narrow down candidate files based on the ranges of the record keys. This method ensures the uniqueness of keys within partitions. +- **GLOBAL_BLOOM:** Utilizes bloom filters created from record keys, and may also refine the selection of candidate files by using the ranges of record keys. This ensures that keys are unique throughout all partitions in the table. +- **SIMPLE (default for Spark engines):** This is the standard index type for the Spark engine. It executes an efficient join of incoming records with keys retrieved from the table stored on disk, ensuring that keys are unique within partitions. - **GLOBAL_SIMPLE:** Performs a lean join of the incoming records against keys extracted from the table on storage. Key uniqueness is enforced across all partitions in the table. Review Comment: @xushiyan are you referring to global_simple description? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
