noahtaite commented on issue #8925:
URL: https://github.com/apache/hudi/issues/8925#issuecomment-1668301296

   @ad1happy2go 
   
   Driver logs during delay time attached. One interesting thing to note is 
that the driver logs are unavailable/restarted shortly before the delay. We are 
also using EMR managed scaling and notice that the cluster goes down to 1 
master, 5 core, 0 task nodes during this time (from a maximum of 40 task nodes 
during the job).
   
   https://gist.github.com/noahtaite/e0309969c05ea3a825ed41a3f2065e21
   
   
![image](https://github.com/apache/hudi/assets/24283126/97b35f49-339c-4fb0-a9e2-516b62058498)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to