HuangZhenQiu commented on code in PR #18998: URL: https://github.com/apache/hudi/pull/18998#discussion_r3409006523
########## rfc/README.md: ########## @@ -34,111 +34,112 @@ The list of all RFCs can be found here. > Older RFC content is still > [here](https://cwiki.apache.org/confluence/display/HUDI/RFC+Process). -| RFC Number | Title | Status | -| ------------ |----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| ----------------------------------- | -| 1 | [CSV Source Support for Delta Streamer](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+01+%3A+CSV+Source+Support+for+Delta+Streamer) | :white_check_mark: `COMPLETED` | -| 2 | [ORC Storage in Hudi](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=113708439) | :white_check_mark: `COMPLETED` | -| 3 | [Timeline Service with Incremental File System View Syncing](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=113708965) | :white_check_mark: `COMPLETED` | -| 4 | [Faster Hive incremental pull queries](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=115513622) | :white_check_mark: `COMPLETED` | -| 5 | [HUI (Hudi WebUI)](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=130027233) | :x: `ABANDONED` | -| 6 | [Add indexing support to the log file](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+06+%3A+Add+indexing+support+to+the+log+file) | :x: `ABANDONED` | -| 7 | [Point in time Time-Travel queries on Hudi table](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+07+%3A+Point+in+time+Time-Travel+queries+on+Hudi+table) | :white_check_mark: `COMPLETED` | -| 8 | [Metadata based Record Index](./rfc-8/rfc-8.md) | :white_check_mark: `COMPLETED` | -| 9 | [Hudi Dataset Snapshot Exporter](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+09+%3A+Hudi+Dataset+Snapshot+Exporter) | :white_check_mark: `COMPLETED` | -| 10 | [Restructuring and auto-generation of docs](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+10+%3A+Restructuring+and+auto-generation+of+docs) | :white_check_mark: `COMPLETED` | -| 11 | [Refactor of the configuration framework of hudi project](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+11+%3A+Refactor+of+the+configuration+framework+of+hudi+project) | :x: `ABANDONED` | -| 12 | [Efficient Migration of Large Parquet Tables to Apache Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+12+%3A+Efficient+Migration+of+Large+Parquet+Tables+to+Apache+Hudi) | :white_check_mark: `COMPLETED` | -| 13 | [Integrate Hudi with Flink](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=141724520) | :white_check_mark: `COMPLETED` | -| 14 | [JDBC incremental puller](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+14+%3A+JDBC+incremental+puller) | :white_check_mark: `COMPLETED` | -| 15 | [HUDI File Listing Improvements](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+15%3A+HUDI+File+Listing+Improvements) | :white_check_mark: `COMPLETED` | -| 16 | [Abstraction for HoodieInputFormat and RecordReader](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+16+Abstraction+for+HoodieInputFormat+and+RecordReader) | :white_check_mark: `COMPLETED` | -| 17 | [Abstract common meta sync module support multiple meta service](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+17+Abstract+common+meta+sync+module+support+multiple+meta+service) | :white_check_mark: `COMPLETED` | -| 18 | [Insert Overwrite API](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+18+Insert+Overwrite+API) | :white_check_mark: `COMPLETED` | -| 19 | [Clustering data for freshness and query performance](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+19+Clustering+data+for+freshness+and+query+performance) | :white_check_mark: `COMPLETED` | -| 20 | [handle failed records](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+20+%3A+handle+failed+records) | :arrows_counterclockwise: `ONGOING` | -| 21 | [Allow HoodieRecordKey to be Virtual](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+21+%3A+Allow+HoodieRecordKey+to+be+Virtual) | :white_check_mark: `COMPLETED` | -| 22 | [Snapshot Isolation using Optimistic Concurrency Control for multi-writers](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers) | :white_check_mark: `COMPLETED` | -| 23 | [Hudi Observability metrics collection](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+23+%3A+Hudi+Observability+metrics+collection) | :x: `ABANDONED` | -| 24 | [Hoodie Flink Writer Proposal](https://cwiki.apache.org/confluence/display/HUDI/RFC-24%3A+Hoodie+Flink+Writer+Proposal) | :white_check_mark: `COMPLETED` | -| 25 | [Spark SQL Extension For Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+25%3A+Spark+SQL+Extension+For+Hudi) | :white_check_mark: `COMPLETED` | -| 26 | [Optimization For Hudi Table Query](https://cwiki.apache.org/confluence/display/HUDI/RFC-26+Optimization+For+Hudi+Table+Query) | :white_check_mark: `COMPLETED` | -| 27 | [Data skipping index to improve query performance](https://cwiki.apache.org/confluence/display/HUDI/RFC-27+Data+skipping+index+to+improve+query+performance) | :white_check_mark: `COMPLETED` | -| 28 | [Support Z-order curve](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=181307144) | :white_check_mark: `COMPLETED` | -| 29 | [Hash Index](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+29%3A+Hash+Index) | :white_check_mark: `COMPLETED` | -| 30 | [Batch operation](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+30%3A+Batch+operation) | :x: `ABANDONED` | -| 31 | [Hive integration Improvement](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+31%3A+Hive+integration+Improvment) | :x: `ABANDONED` | -| 32 | [Kafka Connect Sink for Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC-32+Kafka+Connect+Sink+for+Hudi) | :arrows_counterclockwise: `ONGOING` | -| 33 | [Hudi supports more comprehensive Schema Evolution](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+33++Hudi+supports+more+comprehensive+Schema+Evolution) | :white_check_mark: `COMPLETED` | -| 34 | [Hudi BigQuery Integration](./rfc-34/rfc-34.md) | :white_check_mark: `COMPLETED` | -| 35 | [Make Flink MOR table writing streaming friendly](https://cwiki.apache.org/confluence/display/HUDI/RFC-35%3A+Make+Flink+MOR+table+writing+streaming+friendly) | :white_check_mark: `COMPLETED` | -| 36 | [HUDI Metastore Server](https://cwiki.apache.org/confluence/display/HUDI/%5BWIP%5D+RFC-36%3A+HUDI+Metastore+Server) | :arrows_counterclockwise: `ONGOING` | -| 37 | [Hudi Metadata based Bloom Index](rfc-37/rfc-37.md) | :white_check_mark: `COMPLETED` | -| 38 | [Spark Datasource V2 Integration](./rfc-38/rfc-38.md) | :white_check_mark: `COMPLETED` | -| 39 | [Incremental source for Debezium](./rfc-39/rfc-39.md) | :white_check_mark: `COMPLETED` | -| 40 | [Connector for Trino](./rfc-40/rfc-40.md) | :white_check_mark: `COMPLETED` | -| 41 | [Snowflake Integration](./rfc-41/rfc-41.md), supported via [Apache XTable (Incubating)](https://xtable.apache.org/) | :x: `ABANDONED` | -| 42 | [Consistent Hashing Index](./rfc-42/rfc-42.md) | :arrows_counterclockwise: `ONGOING` | -| 43 | [Table Management Service](./rfc-43/rfc-43.md) | :x: `ABANDONED` | -| 44 | [Hudi Connector for Presto](./rfc-44/rfc-44.md) | :white_check_mark: `COMPLETED` | -| 45 | [Asynchronous Metadata Indexing](./rfc-45/rfc-45.md) | :white_check_mark: `COMPLETED` | -| 46 | [Optimizing Record Payload Handling](./rfc-46/rfc-46.md) | :white_check_mark: `COMPLETED` | -| 47 | [Add Call Produce Command for Spark SQL](./rfc-47/rfc-47.md) | :white_check_mark: `COMPLETED` | -| 48 | [LogCompaction for MOR tables](./rfc-48/rfc-48.md) | :white_check_mark: `COMPLETED` | -| 49 | [Support sync with DataHub](./rfc-49/rfc-49.md) | :white_check_mark: `COMPLETED` | -| 50 | [Improve Timeline Server](./rfc-50/rfc-50.md) | :x: `ABANDONED` | -| 51 | [Change Data Capture](./rfc-51/rfc-51.md) | :arrows_counterclockwise: `ONGOING` | -| 52 | [Introduce Secondary Index to Improve HUDI Query Performance](./rfc-52/rfc-52.md) | :x: `ABANDONED` | -| 53 | [Use Lock-Free Message Queue Improving Hoodie Writing Efficiency](./rfc-53/rfc-53.md) | :white_check_mark: `COMPLETED` | -| 54 | [New Table APIs and Streamline Hudi Configs](./rfc-54/rfc-54.md) | :x: `ABANDONED` | -| 55 | [Improve Hive/Meta sync class design and hierarchies](./rfc-55/rfc-55.md) | :white_check_mark: `COMPLETED` | -| 56 | [Early Conflict Detection For Multi-Writer](./rfc-56/rfc-56.md) | :white_check_mark: `COMPLETED` | -| 57 | [DeltaStreamer Protobuf Support](./rfc-57/rfc-57.md) | :white_check_mark: `COMPLETED` | -| 58 | [Integrate column stats index with all query engines](./rfc-58/rfc-58.md) | :white_check_mark: `COMPLETED` | -| 59 | [Multiple event_time Fields Latest Verification in a Single Table](./rfc-59/rfc-59.md) | :eyes: `UNDER REVIEW` | -| 60 | [Federated Storage Layer](./rfc-60/rfc-60.md) | :eyes: `UNDER REVIEW` | -| 61 | [Snapshot view management](./rfc-61/rfc-61.md) | :eyes: `UNDER REVIEW` | -| 62 | [Diagnostic Reporter](./rfc-62/rfc-62.md) | :eyes: `UNDER REVIEW` | -| 63 | [Expression Indexes](./rfc-63/rfc-63.md) | :arrows_counterclockwise: `ONGOING` | -| 64 | [New Hudi Table Spec API for Query Integrations](./rfc-64/rfc-64.md) | :eyes: `UNDER REVIEW` | -| 65 | [Partition TTL Management](./rfc-65/rfc-65.md) | :white_check_mark: `COMPLETED` | -| 66 | [Non Blocking Concurrency Control](./rfc-66/rfc-66.md) | :white_check_mark: `COMPLETED` | -| 67 | [Hudi Bundle Standards](./rfc-67/rfc-67.md) | :white_check_mark: `COMPLETED` | -| 68 | [A More Effective HoodieMergeHandler for COW Table with Parquet](./rfc-68/rfc-68.md) | :x: `ABANDONED` | -| 69 | [Hudi 1.x](./rfc-69/rfc-69.md) | :white_check_mark: `COMPLETED` | -| 70 | [Hudi Reverse Streamer](./rfc/rfc-70/rfc-70.md) | :eyes: `UNDER REVIEW` | -| 71 | [Enhance OCC conflict detection](./rfc/rfc-71/rfc-71.md) | :eyes: `UNDER REVIEW` | -| 72 | [Redesign Hudi-Spark Integration](./rfc/rfc-72/rfc-72.md) | :arrows_counterclockwise: `ONGOING` | -| 73 | [Multi-Table Transactions](./rfc-73/rfc-73.md) | :eyes: `UNDER REVIEW` | -| 74 | [`HoodieStorage`: Hudi Storage Abstraction and APIs](./rfc-74/rfc-74.md) | :arrows_counterclockwise: `ONGOING` | -| 75 | [Hudi-Native HFile Reader and Writer](./rfc-75/rfc-75.md) | :white_check_mark: `COMPLETED` | -| 76 | [Auto Record key generation](./rfc-76/rfc-76.md) | :white_check_mark: `COMPLETED` | -| 77 | [Secondary Index](./rfc-77/rfc-77.md) | :white_check_mark: `COMPLETED` | -| 78 | [1.0 Migration](./rfc-78/rfc-78.md) | :hammer_and_wrench: `IN PROGRESS` | -| 79 | [Robust handling of spark task retries and failures](./rfc-79/rfc-79.md) | :x: `ABANDONED` | -| 80 | [Column Groups](./rfc-80/rfc-80.md) | :hammer_and_wrench: `IN PROGRESS` | -| 81 | [Introduce Primary Key Sorted Table](./rfc-81/rfc-81.md) | :eyes: `UNDER REVIEW` | -| 82 | [Concurrent schema evolution detection](./rfc-82/rfc-82.md) | :white_check_mark: `COMPLETED` | -| 83 | [Incremental Table Service](./rfc-83/rfc-83.md) | :white_check_mark: `COMPLETED` | -| 84 | [Optimized SerDe of `DataStream` in Flink operators](./rfc-84/rfc-84.md) | :white_check_mark: `COMPLETED` | -| 85 | [Hudi Issue and Sprint Management in Jira](./rfc-85/rfc-85.md) | :white_check_mark: `COMPLETED` | -| 86 | [DataFrame Implementation of HUDI write path](./rfc-86/rfc-86.md) | :eyes: `UNDER REVIEW` | -| 87 | [Avro elimination for Flink writer](./rfc-87/rfc-87.md) | :hammer_and_wrench: `IN PROGRESS` | -| 88 | [New Schema/DataType/Expression Abstractions](./rfc-88/rfc-88.md) | :eyes: `UNDER REVIEW` | -| 89 | [Dynamic Partition Level Bucket Index](./rfc-89/rfc-89.md) | :eyes: `UNDER REVIEW` | -| 90 | Add support for cancellable clustering table service plans | :eyes: `UNDER REVIEW` | -| 91 | [Storage-based lock provider using conditional writes](./rfc-91/rfc-91.md) | :white_check_mark: `COMPLETED` | -| 92 | Support Bitmap Index | :hammer_and_wrench: `IN PROGRESS` | -| 93 | [Pluggable Table Formats in Hudi](./rfc-93/rfc-93.md) | :hammer_and_wrench: `IN PROGRESS` | -| 94 | Hudi Timeline User Interface (UI) | :eyes: `UNDER REVIEW` | -| 95 | [Hudi Flink Source Based on FLIP-27](./rfc-95/rfc-95.md) | :white_check_mark: `COMPLETED` | -| 96 | Introduce Unified Bucket Index | :eyes: `UNDER REVIEW` | -| 97 | Deprecate Hudi Payload Class Usage | :eyes: `UNDER REVIEW` | -| 98 | [Spark Datasource V2 Read](./rfc-98/rfc-98.md) | :eyes: `UNDER REVIEW` | -| 99 | [Hudi Type System Redesign](./rfc-99/rfc-99.md) | :eyes: `UNDER REVIEW` | -| 100 | [Unstructured Data Storage in Hudi](./rfc-100/rfc-100.md) | :eyes: `UNDER REVIEW` | -| 101 | [Updates to the HoodieRecordMerger API](./rfc-101/rfc-101.md) | :hammer_and_wrench: `IN PROGRESS` | -| 102 | [Spark Batch Vector Search in Apache Hudi](./rfc-102/rfc-102/md) | :white_check_mark: `COMPLETED` | -| 103 | Hudi LSM tree layout | :eyes: `UNDER REVIEW` | -| 104 | [Unify schema evolution on schema-on-read](./rfc-104/rfc-104.md) | :eyes: `UNDER REVIEW` | -| 105 | [Trino Hudi Connector — Shim/Bundle Refactor](./rfc-105/rfc-105.md) | :eyes: `UNDER REVIEW` | -| 106 | [Record Level and Secondary Index Support for Flink Writers](./rfc-106/rfc-106.md) | :white_check_mark: `COMPLETED` | +| RFC Number | Title | Status | +|------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| ----------------------------------- | +| 1 | [CSV Source Support for Delta Streamer](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+01+%3A+CSV+Source+Support+for+Delta+Streamer) | :white_check_mark: `COMPLETED` | +| 2 | [ORC Storage in Hudi](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=113708439) | :white_check_mark: `COMPLETED` | +| 3 | [Timeline Service with Incremental File System View Syncing](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=113708965) | :white_check_mark: `COMPLETED` | +| 4 | [Faster Hive incremental pull queries](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=115513622) | :white_check_mark: `COMPLETED` | +| 5 | [HUI (Hudi WebUI)](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=130027233) | :x: `ABANDONED` | +| 6 | [Add indexing support to the log file](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+06+%3A+Add+indexing+support+to+the+log+file) | :x: `ABANDONED` | +| 7 | [Point in time Time-Travel queries on Hudi table](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+07+%3A+Point+in+time+Time-Travel+queries+on+Hudi+table) | :white_check_mark: `COMPLETED` | +| 8 | [Metadata based Record Index](./rfc-8/rfc-8.md) | :white_check_mark: `COMPLETED` | +| 9 | [Hudi Dataset Snapshot Exporter](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+09+%3A+Hudi+Dataset+Snapshot+Exporter) | :white_check_mark: `COMPLETED` | +| 10 | [Restructuring and auto-generation of docs](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+10+%3A+Restructuring+and+auto-generation+of+docs) | :white_check_mark: `COMPLETED` | +| 11 | [Refactor of the configuration framework of hudi project](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+11+%3A+Refactor+of+the+configuration+framework+of+hudi+project) | :x: `ABANDONED` | +| 12 | [Efficient Migration of Large Parquet Tables to Apache Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+12+%3A+Efficient+Migration+of+Large+Parquet+Tables+to+Apache+Hudi) | :white_check_mark: `COMPLETED` | +| 13 | [Integrate Hudi with Flink](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=141724520) | :white_check_mark: `COMPLETED` | +| 14 | [JDBC incremental puller](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+14+%3A+JDBC+incremental+puller) | :white_check_mark: `COMPLETED` | +| 15 | [HUDI File Listing Improvements](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+15%3A+HUDI+File+Listing+Improvements) | :white_check_mark: `COMPLETED` | +| 16 | [Abstraction for HoodieInputFormat and RecordReader](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+16+Abstraction+for+HoodieInputFormat+and+RecordReader) | :white_check_mark: `COMPLETED` | +| 17 | [Abstract common meta sync module support multiple meta service](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+17+Abstract+common+meta+sync+module+support+multiple+meta+service) | :white_check_mark: `COMPLETED` | +| 18 | [Insert Overwrite API](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+18+Insert+Overwrite+API) | :white_check_mark: `COMPLETED` | +| 19 | [Clustering data for freshness and query performance](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+19+Clustering+data+for+freshness+and+query+performance) | :white_check_mark: `COMPLETED` | +| 20 | [handle failed records](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+20+%3A+handle+failed+records) | :arrows_counterclockwise: `ONGOING` | +| 21 | [Allow HoodieRecordKey to be Virtual](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+21+%3A+Allow+HoodieRecordKey+to+be+Virtual) | :white_check_mark: `COMPLETED` | +| 22 | [Snapshot Isolation using Optimistic Concurrency Control for multi-writers](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers) | :white_check_mark: `COMPLETED` | +| 23 | [Hudi Observability metrics collection](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+23+%3A+Hudi+Observability+metrics+collection) | :x: `ABANDONED` | +| 24 | [Hoodie Flink Writer Proposal](https://cwiki.apache.org/confluence/display/HUDI/RFC-24%3A+Hoodie+Flink+Writer+Proposal) | :white_check_mark: `COMPLETED` | +| 25 | [Spark SQL Extension For Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+25%3A+Spark+SQL+Extension+For+Hudi) | :white_check_mark: `COMPLETED` | +| 26 | [Optimization For Hudi Table Query](https://cwiki.apache.org/confluence/display/HUDI/RFC-26+Optimization+For+Hudi+Table+Query) | :white_check_mark: `COMPLETED` | +| 27 | [Data skipping index to improve query performance](https://cwiki.apache.org/confluence/display/HUDI/RFC-27+Data+skipping+index+to+improve+query+performance) | :white_check_mark: `COMPLETED` | +| 28 | [Support Z-order curve](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=181307144) | :white_check_mark: `COMPLETED` | +| 29 | [Hash Index](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+29%3A+Hash+Index) | :white_check_mark: `COMPLETED` | +| 30 | [Batch operation](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+30%3A+Batch+operation) | :x: `ABANDONED` | +| 31 | [Hive integration Improvement](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+31%3A+Hive+integration+Improvment) | :x: `ABANDONED` | +| 32 | [Kafka Connect Sink for Hudi](https://cwiki.apache.org/confluence/display/HUDI/RFC-32+Kafka+Connect+Sink+for+Hudi) | :arrows_counterclockwise: `ONGOING` | +| 33 | [Hudi supports more comprehensive Schema Evolution](https://cwiki.apache.org/confluence/display/HUDI/RFC+-+33++Hudi+supports+more+comprehensive+Schema+Evolution) | :white_check_mark: `COMPLETED` | +| 34 | [Hudi BigQuery Integration](./rfc-34/rfc-34.md) | :white_check_mark: `COMPLETED` | +| 35 | [Make Flink MOR table writing streaming friendly](https://cwiki.apache.org/confluence/display/HUDI/RFC-35%3A+Make+Flink+MOR+table+writing+streaming+friendly) | :white_check_mark: `COMPLETED` | +| 36 | [HUDI Metastore Server](https://cwiki.apache.org/confluence/display/HUDI/%5BWIP%5D+RFC-36%3A+HUDI+Metastore+Server) | :arrows_counterclockwise: `ONGOING` | +| 37 | [Hudi Metadata based Bloom Index](rfc-37/rfc-37.md) | :white_check_mark: `COMPLETED` | +| 38 | [Spark Datasource V2 Integration](./rfc-38/rfc-38.md) | :white_check_mark: `COMPLETED` | +| 39 | [Incremental source for Debezium](./rfc-39/rfc-39.md) | :white_check_mark: `COMPLETED` | +| 40 | [Connector for Trino](./rfc-40/rfc-40.md) | :white_check_mark: `COMPLETED` | +| 41 | [Snowflake Integration](./rfc-41/rfc-41.md), supported via [Apache XTable (Incubating)](https://xtable.apache.org/) | :x: `ABANDONED` | +| 42 | [Consistent Hashing Index](./rfc-42/rfc-42.md) | :arrows_counterclockwise: `ONGOING` | +| 43 | [Table Management Service](./rfc-43/rfc-43.md) | :x: `ABANDONED` | +| 44 | [Hudi Connector for Presto](./rfc-44/rfc-44.md) | :white_check_mark: `COMPLETED` | +| 45 | [Asynchronous Metadata Indexing](./rfc-45/rfc-45.md) | :white_check_mark: `COMPLETED` | +| 46 | [Optimizing Record Payload Handling](./rfc-46/rfc-46.md) | :white_check_mark: `COMPLETED` | +| 47 | [Add Call Produce Command for Spark SQL](./rfc-47/rfc-47.md) | :white_check_mark: `COMPLETED` | +| 48 | [LogCompaction for MOR tables](./rfc-48/rfc-48.md) | :white_check_mark: `COMPLETED` | +| 49 | [Support sync with DataHub](./rfc-49/rfc-49.md) | :white_check_mark: `COMPLETED` | +| 50 | [Improve Timeline Server](./rfc-50/rfc-50.md) | :x: `ABANDONED` | +| 51 | [Change Data Capture](./rfc-51/rfc-51.md) | :arrows_counterclockwise: `ONGOING` | +| 52 | [Introduce Secondary Index to Improve HUDI Query Performance](./rfc-52/rfc-52.md) | :x: `ABANDONED` | +| 53 | [Use Lock-Free Message Queue Improving Hoodie Writing Efficiency](./rfc-53/rfc-53.md) | :white_check_mark: `COMPLETED` | +| 54 | [New Table APIs and Streamline Hudi Configs](./rfc-54/rfc-54.md) | :x: `ABANDONED` | +| 55 | [Improve Hive/Meta sync class design and hierarchies](./rfc-55/rfc-55.md) | :white_check_mark: `COMPLETED` | +| 56 | [Early Conflict Detection For Multi-Writer](./rfc-56/rfc-56.md) | :white_check_mark: `COMPLETED` | +| 57 | [DeltaStreamer Protobuf Support](./rfc-57/rfc-57.md) | :white_check_mark: `COMPLETED` | +| 58 | [Integrate column stats index with all query engines](./rfc-58/rfc-58.md) | :white_check_mark: `COMPLETED` | +| 59 | [Multiple event_time Fields Latest Verification in a Single Table](./rfc-59/rfc-59.md) | :eyes: `UNDER REVIEW` | +| 60 | [Federated Storage Layer](./rfc-60/rfc-60.md) | :eyes: `UNDER REVIEW` | +| 61 | [Snapshot view management](./rfc-61/rfc-61.md) | :eyes: `UNDER REVIEW` | +| 62 | [Diagnostic Reporter](./rfc-62/rfc-62.md) | :eyes: `UNDER REVIEW` | +| 63 | [Expression Indexes](./rfc-63/rfc-63.md) | :arrows_counterclockwise: `ONGOING` | +| 64 | [New Hudi Table Spec API for Query Integrations](./rfc-64/rfc-64.md) | :eyes: `UNDER REVIEW` | +| 65 | [Partition TTL Management](./rfc-65/rfc-65.md) | :white_check_mark: `COMPLETED` | +| 66 | [Non Blocking Concurrency Control](./rfc-66/rfc-66.md) | :white_check_mark: `COMPLETED` | +| 67 | [Hudi Bundle Standards](./rfc-67/rfc-67.md) | :white_check_mark: `COMPLETED` | +| 68 | [A More Effective HoodieMergeHandler for COW Table with Parquet](./rfc-68/rfc-68.md) | :x: `ABANDONED` | +| 69 | [Hudi 1.x](./rfc-69/rfc-69.md) | :white_check_mark: `COMPLETED` | +| 70 | [Hudi Reverse Streamer](./rfc/rfc-70/rfc-70.md) | :eyes: `UNDER REVIEW` | +| 71 | [Enhance OCC conflict detection](./rfc/rfc-71/rfc-71.md) | :eyes: `UNDER REVIEW` | +| 72 | [Redesign Hudi-Spark Integration](./rfc/rfc-72/rfc-72.md) | :arrows_counterclockwise: `ONGOING` | +| 73 | [Multi-Table Transactions](./rfc-73/rfc-73.md) | :eyes: `UNDER REVIEW` | +| 74 | [`HoodieStorage`: Hudi Storage Abstraction and APIs](./rfc-74/rfc-74.md) | :arrows_counterclockwise: `ONGOING` | +| 75 | [Hudi-Native HFile Reader and Writer](./rfc-75/rfc-75.md) | :white_check_mark: `COMPLETED` | +| 76 | [Auto Record key generation](./rfc-76/rfc-76.md) | :white_check_mark: `COMPLETED` | +| 77 | [Secondary Index](./rfc-77/rfc-77.md) | :white_check_mark: `COMPLETED` | +| 78 | [1.0 Migration](./rfc-78/rfc-78.md) | :hammer_and_wrench: `IN PROGRESS` | +| 79 | [Robust handling of spark task retries and failures](./rfc-79/rfc-79.md) | :x: `ABANDONED` | +| 80 | [Column Groups](./rfc-80/rfc-80.md) | :hammer_and_wrench: `IN PROGRESS` | +| 81 | [Introduce Primary Key Sorted Table](./rfc-81/rfc-81.md) | :eyes: `UNDER REVIEW` | +| 82 | [Concurrent schema evolution detection](./rfc-82/rfc-82.md) | :white_check_mark: `COMPLETED` | +| 83 | [Incremental Table Service](./rfc-83/rfc-83.md) | :white_check_mark: `COMPLETED` | +| 84 | [Optimized SerDe of `DataStream` in Flink operators](./rfc-84/rfc-84.md) | :white_check_mark: `COMPLETED` | +| 85 | [Hudi Issue and Sprint Management in Jira](./rfc-85/rfc-85.md) | :white_check_mark: `COMPLETED` | +| 86 | [DataFrame Implementation of HUDI write path](./rfc-86/rfc-86.md) | :eyes: `UNDER REVIEW` | +| 87 | [Avro elimination for Flink writer](./rfc-87/rfc-87.md) | :hammer_and_wrench: `IN PROGRESS` | +| 88 | [New Schema/DataType/Expression Abstractions](./rfc-88/rfc-88.md) | :eyes: `UNDER REVIEW` | +| 89 | [Dynamic Partition Level Bucket Index](./rfc-89/rfc-89.md) | :eyes: `UNDER REVIEW` | +| 90 | Add support for cancellable clustering table service plans | :eyes: `UNDER REVIEW` | +| 91 | [Storage-based lock provider using conditional writes](./rfc-91/rfc-91.md) | :white_check_mark: `COMPLETED` | +| 92 | Support Bitmap Index | :hammer_and_wrench: `IN PROGRESS` | +| 93 | [Pluggable Table Formats in Hudi](./rfc-93/rfc-93.md) | :hammer_and_wrench: `IN PROGRESS` | +| 94 | Hudi Timeline User Interface (UI) | :eyes: `UNDER REVIEW` | +| 95 | [Hudi Flink Source Based on FLIP-27](./rfc-95/rfc-95.md) | :white_check_mark: `COMPLETED` | +| 96 | Introduce Unified Bucket Index | :eyes: `UNDER REVIEW` | +| 97 | Deprecate Hudi Payload Class Usage | :eyes: `UNDER REVIEW` | +| 98 | [Spark Datasource V2 Read](./rfc-98/rfc-98.md) | :eyes: `UNDER REVIEW` | +| 99 | [Hudi Type System Redesign](./rfc-99/rfc-99.md) | :eyes: `UNDER REVIEW` | +| 100 | [Unstructured Data Storage in Hudi](./rfc-100/rfc-100.md) | :eyes: `UNDER REVIEW` | +| 101 | [Updates to the HoodieRecordMerger API](./rfc-101/rfc-101.md) | :hammer_and_wrench: `IN PROGRESS` | +| 102 | [Spark Batch Vector Search in Apache Hudi](./rfc-102/rfc-102/md) | :white_check_mark: `COMPLETED` | +| 103 | Hudi LSM tree layout | :eyes: `UNDER REVIEW` | +| 104 | [Unify schema evolution on schema-on-read](./rfc-104/rfc-104.md) | :eyes: `UNDER REVIEW` | +| 105 | [Trino Hudi Connector — Shim/Bundle Refactor](./rfc-105/rfc-105.md) | :eyes: `UNDER REVIEW` | +| 106 | [Record Level and Secondary Index Support for Flink Writers](./rfc-106/rfc-106.md) | :white_check_mark: `COMPLETED` | +| 107 | Dynamic Partitioned Cache for Flink upsert | :hammer_and_wrench: `IN PROGRESS` | Review Comment: It is a mistake. Updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
