Toroidals commented on issue #10907: URL: https://github.com/apache/hudi/issues/10907#issuecomment-2014457517
@ad1happy2go The amount of data in my table is very large, around 350 million records. The size of each individual Parquet file is around 400MB. I am using index type=bucket, hoodie.bucket.index.num.buckets=SIMPLE, and hoodie.bucket.index.num.buckets=128. Can increasing hoodie.bucket.index.num.buckets and compaction tasks help mitigate this issue, or are there other good solutions available? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
