[GitHub] [hudi] n3nash commented on issue #2806: Spark upsert Hudi performance degrades significantly

n3nash commented on issue #2806: URL: https://github.com/apache/hudi/issues/2806#issuecomment-854401941 @tmac2100 Closing this ticket due to inactivity, hopefully the information is helpful. If you need further assistance, please re-open or open another issue. -- This is an automated

[GitHub] [hudi] n3nash commented on issue #2806: Spark upsert Hudi performance degrades significantly

n3nash commented on issue #2806: URL: https://github.com/apache/hudi/issues/2806#issuecomment-854401941 @tmac2100 Closing this ticket due to inactivity, hopefully the information is helpful. If you need further assistance, please re-open or open another issue. -- This is an automated

[GitHub] [hudi] n3nash commented on issue #2806: Spark upsert Hudi performance degrades significantly

n3nash commented on issue #2806: URL: https://github.com/apache/hudi/issues/2806#issuecomment-826576866 @tmac2100 Yes, that is expected. The more number of fileIds touched by your updates, the higher the runtime. Although, there could be more factors governing this. 1. Are you

[GitHub] [hudi] n3nash commented on issue #2806: Spark upsert Hudi performance degrades significantly

n3nash commented on issue #2806: URL: https://github.com/apache/hudi/issues/2806#issuecomment-820155041 @tmac2100 Thanks for those details, they are very helpful to understand your job. I need one more information before I can understand the root cause, can you please put a screenshot of

[GitHub] [hudi] n3nash commented on issue #2806: Spark upsert Hudi performance degrades significantly

n3nash commented on issue #2806: URL: https://github.com/apache/hudi/issues/2806#issuecomment-818455085 @tmac2100 The commands you have provided to reproduce this issue seem to be related to the internal working of your company. I'm unable to reproduce this issue with the given command.