MrAladdin opened a new issue, #10972: URL: https://github.com/apache/hudi/issues/10972
**Describe the problem you faced** spark structured streaming upsert hudi(mor、RECORD_INDEX) --- very time consuming ： 1、The number of tasks in each distinct stage of building workload profile is always 60, and there is a severe data skew. I want to know why it's always 60, how to adjust, the reasons for data skew and optimization solutions. I have done my best. **Environment Description** * Hudi version :0.14.1 * Spark version :3.4.1 * Hive version :3.1.2 * Hadoop version :3.1.3 * Storage (HDFS/S3/GCS..) :hdfs * Running on Docker? (yes/no) :no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
