yongster commented on issue #11676: URL: https://github.com/apache/hudi/issues/11676#issuecomment-2246742149
> The main reason that Flink does not support RLI is because RLI is kind of costly for committing to the Hudi table, while in streaming ingestion, the handling of the checkpoints ack (the Hudi instants are committed in this process) expect to be short in time, otherwise it may induce instability to the pipeline. > > Do you want the RLI to speed up queries or the ingestion upsert? Currently, I have a table in DW. It's written into by Flink consuming from Kafka. Users need to query it through Spark engine. The amount of data is very large, so I want to add RLI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
