Gatsby-Lee commented on issue #4873: URL: https://github.com/apache/hudi/issues/4873#issuecomment-1050255151
@cafelo-pfdrive oh. you need the Compaction if you want to use MoR. In Glue, ( if I am right ), Table compaction doesn't happen automatically for you. ( you might have to setup a new Glue Job that does the Compaction if you want to run it Async ) if the Compaction doesn't happen, then you will have lots of small files in the data directory. And it will keep slow down the overall Hudi write. I think `hoodie.compact.inline` is false by default. `hoodie.datasource.compaction.async.enable` is true by default. if you don't want to bring up a extra Glue Job for the compaction. you can set true for `hoodie.compact.inline`, then it will run compaction service for every write. If so, then I guess you might not get the benefit of using MoR. I hope this helps you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
