nsivabalan commented on issue #14468: URL: https://github.com/apache/hudi/issues/14468#issuecomment-4795166277
Triage note: This feature request appears to be effectively obsolete. The original motivation — enabling near-real-time MOR ingest without forcing parquet writes for inserts — has since been addressed by: 1. **Record-Level Index (RFC-08)** — implemented in the metadata table (`HoodieRecordIndex`, RLI partition in `HoodieMetadataPayload`), providing efficient record-to-file-group mapping without needing to index the log format itself. 2. **Clustering** — creates new file groups for inserts as needed. The original reporter [explicitly stated in the JIRA](https://issues.apache.org/jira/browse/HUDI-86) (Jul 2020): *"I think the conclusion was we won't need this given RFC-08 .. and also the clustering approach."* Unless there's a new use case that RLI + clustering don't cover, this issue can likely be closed as `Won't Fix` / superseded by RFC-08. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
