ad1happy2go commented on issue #12116: URL: https://github.com/apache/hudi/issues/12116#issuecomment-2434758665
@dataproblems There is some problem here. For a 100 GB data you should not have 40 MB commit file. Only reason that could be the possible is nature of your partition column. How many partitions you have, i mean how many unique values are there in your dataset for your partition column -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
