maheshguptags commented on issue #8195: URL: https://github.com/apache/hudi/issues/8195#issuecomment-1471521198
Hi @hbgstc123 and @danny0405, I tried the suggestions that you guys suggest with `MOR` and `COW` both but it doesn't seem to work with any combination. Let me share the configuration and screenshot that I tried. I would also like to ask you guys for an example/use case where you have implemented inline clustering with the Flink job or we can set up a call to discuss this issue in more detail. **MOR config** ``` 'table.type' = 'MERGE_ON_READ', 'hoodie.datasource.write.operation'='insert', 'hoodie.compact.inline'= 'true', 'hoodie.compact.inline.max.delta.commits'='2', 'hoodie.clean.max.commits'='2', 'hoodie.cleaner.commits.retained' = '3', 'hoodie.clean.async'='true', 'hoodie.cleaner.policy' = 'KEEP_LATEST_COMMITS', 'hoodie.parquet.small.file.limit'='104857600', 'clustering.schedule.enabled'='true', 'clustering.async.enabled'='true', 'hoodie.clustering.inline'= 'true', 'hoodie.clustering.inline.max.commits'= '2', 'hoodie.clustering.plan.strategy.max.bytes.per.group'= '107374182400', 'hoodie.clustering.plan.strategy.max.num.groups'= '1' ```  **COW config** ``` 'table.type' = 'COPY_ON_WRITE', 'hoodie.datasource.write.operation'='insert', 'hoodie.clean.max.commits'='2', 'hoodie.cleaner.commits.retained' = '3', 'hoodie.clean.async'='true','hoodie.cleaner.policy' = 'KEEP_LATEST_COMMITS', 'hoodie.parquet.small.file.limit'='104857600', 'clustering.schedule.enabled'='true', 'clustering.async.enabled'='true', 'hoodie.clustering.inline'= 'true', 'hoodie.clustering.inline.max.commits'= '2', 'hoodie.clustering.plan.strategy.max.bytes.per.group'= '107374182400', 'hoodie.clustering.plan.strategy.max.num.groups'= '1' ```  Thanks Mahesh -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
