SamarthRaval commented on issue #8925: URL: https://github.com/apache/hudi/issues/8925#issuecomment-1586277627
> Did the cleaning eventually finished ? I already had such issue of slow cleaning and in appearance it does noting but spark is being dealing with s3 fs which mainly uses networking. > […](#) > On June 11, 2023 2:53:08 AM UTC, Samarth Raval ***@***.***> wrote: @parisni I tried cleaning stuff but in between stages it was idle for more then hour, where EMR job was idle and doing nothing, do you ever seen that before or someone has something like this before ? Between stages 45 & 46 it was idle for almost ~1.2 hours  -- Reply to this email directly or view it on GitHub: [#8925 (comment)](https://github.com/apache/hudi/issues/8925#issuecomment-1585982752) You are receiving this because you were mentioned. Message ID: ***@***.***> I think so cleaning did actually finish but the in between stage 45 & 46 is the significant delay, if we know whats the problem there may be EMR job can finish <1.5 hrs [which would be best] <img width="1529" alt="image" src="https://github.com/apache/hudi/assets/8738019/39e4b0ea-f2ae-451f-b3bb-cee9d0ff6cc0";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
