nbeeee commented on issue #11680:
URL: https://github.com/apache/hudi/issues/11680#issuecomment-2249590701

   @ad1happy2go 
   spark configuration 
   --master yarn 
   --deploy-mode cluster 
   --driver-memory 2G 
   --executor-memory  10G 
   --executor-cores  5 
   --num-executors 5 
   
   The total data volume of this table is 540 million, with approximately 20 
million written each time. Normally, the task would be completed in 25 minutes. 
I suspect that there was some cleaning done last time that caused it to take a 
long time to complete, and if I terminate it and execute it again today, it 
will be normal
   
![stock_cli](https://github.com/user-attachments/assets/e80acb62-167e-41e7-8bfc-188378f00d23)
   ![Uploading 企业微信截图_17218904169488.png…]()
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to