wankunde commented on PR #45661: URL: https://github.com/apache/spark/pull/45661#issuecomment-2015444180
Test `mv` a 2.6 G file on a node which has a high iowait : ``` $ time mv /hadoop/2/yarn/local/yarn-yarn-nodemanager.log.10 /hadoop/3/yarn/local/yarn-yarn-nodemanager.log.10 real 2m19.694s user 0m0.029s sys 0m6.120s $ time mv /hadoop/3/yarn/local/yarn-yarn-nodemanager.log.10 /hadoop/3/yarn/local/yarn-yarn-nodemanager.log.11 real 0m0.003s user 0m0.001s sys 0m0.001s ``` When we mv file to another disk which has a high iowait , it will be quite slow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
