subject:"\[GitHub\] \[hudi\] nsivabalan edited a comment on issue #3605\: \[SUPPORT\]Hudi Inserts and Upserts for MoR and CoW tables are taking very long time."

[GitHub] [hudi] nsivabalan edited a comment on issue #3605: [SUPPORT]Hudi Inserts and Upserts for MoR and CoW tables are taking very long time.

2021-10-07 Thread GitBox

nsivabalan edited a comment on issue #3605: URL: https://github.com/apache/hudi/issues/3605#issuecomment-937435741 sorry, whats the shuffle parallelism you are setting for these writes? In your original description, I see you are setting it to 2. definitely that would give you bad perf.

[GitHub] [hudi] nsivabalan edited a comment on issue #3605: [SUPPORT]Hudi Inserts and Upserts for MoR and CoW tables are taking very long time.

2021-10-06 Thread GitBox

nsivabalan edited a comment on issue #3605: URL: https://github.com/apache/hudi/issues/3605#issuecomment-937435741 sorry, whats the shuffle parallelism you are setting for these writes? In your original description, I see you are setting it to 2. definitely that would give you bad perf.