[GitHub] [hudi] WTa-hash commented on issue #2229: [SUPPORT] UpsertPartitioner performance

2021-01-05 Thread GitBox
WTa-hash commented on issue #2229: URL: https://github.com/apache/hudi/issues/2229#issuecomment-754894794 @bvaradar - I would like to understand a little bit more about what's going on here with the spark stage "Getting small files from partitions" from the screenshot.

[GitHub] [hudi] WTa-hash commented on issue #2229: [SUPPORT] UpsertPartitioner performance

2020-11-05 Thread GitBox
WTa-hash commented on issue #2229: URL: https://github.com/apache/hudi/issues/2229#issuecomment-722808651 > Just want to make sure if you understood compaction vs cleaning in Hudi. Why do you want to wait for 30 days before running compaction ? Do you mean cleaning the old versions 30

[GitHub] [hudi] WTa-hash commented on issue #2229: [SUPPORT] UpsertPartitioner performance

2020-11-05 Thread GitBox
WTa-hash commented on issue #2229: URL: https://github.com/apache/hudi/issues/2229#issuecomment-722564973 > Yes, you can get the details here : https://hudi.apache.org/blog/async-compaction-deployment-model/ Hi @bvaradar - In the link provided, I see the example has