zhaomoran opened a new pull request, #13193: URL: https://github.com/apache/hudi/pull/13193
### Change Logs Updated the logic for estimating averageCDCRecordSize during CDC block accumulation. Instead of estimating the size only once based on the first record, the estimation is now refreshed every 100 records using an exponential moving average ### Impact Reduces the risk of OOM caused by underestimating memory usage due to anomalously small initial CDC records. Enables more accurate triggering of CDC block flushes, improving memory stability during write operations. The change maintains minimal overhead by updating the estimation infrequently (every 100 records) and smoothing transitions using a weighted average. ### Risk level (write none, low medium or high below) none ### Documentation Update none ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Change Logs and Impact were stated clearly - [x] Adequate tests were added if applicable - [x] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
