hudi-bot opened a new issue, #15396: URL: https://github.com/apache/hudi/issues/15396
Is there a size threshold to exclude big log blocks? Why do log compaction on log blocks that are big enough? Thoughts Good point. For initial version we want to target all the blocks. In the coming iterations I will include block sizes threshold as well. Current logic of AbstractHoodieLogRecordReader should be able to handle it as well. For streaming workloads, this might be very heavy. So, we need to support this. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-4728 - Type: Improvement - Epic: https://issues.apache.org/jira/browse/HUDI-3580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
