n3nash commented on issue #2934: URL: https://github.com/apache/hudi/issues/2934#issuecomment-842007240
@t0il3ts0ap Can you please share some more information so I can help you. 1. What is the rate of new data written to the source table ? Are there many updates to the source table ? 2. How many commits happen on the source table every day ? 3. What are your settings for`hoodie.cleaner.policy` and corresponding value for that policy (for eg. hoodie.cleaner.commits.retained) ? 4. How often are you running the deltastreamer to generate the downstream fresh table ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
