huangtianhua commented on issue #25227: [SPARK-28467][CORE][TEST] Increase timeout to up executors for tests URL: https://github.com/apache/spark/pull/25227#issuecomment-513696643 @dongjoon-hyun Thanks. Sorry, I will add the environment: zuul@ubuntu:~/src/github.com/theopenlab/spark$ uname -a Linux ubuntu 4.15.0-46-generic #49~16.04.1-Ubuntu SMP Tue Feb 12 17:45:52 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux We use arm instance of vexxhost cloud to run the test, the flavor of the arm instance is 8C8G. And we ran the tests for several times(everytime the instance is new created) and the executor(2 required in test) can't up under 10000ms. The two tests mentioned in [SPARK-28467] is always failed due to timeout(now only these two tests failed due this reason): test driver discovery under local-cluster mode *** FAILED *** java.util.concurrent.TimeoutException: Can't find 1 executors before 10000 milliseconds elapsed ...... test gpu driver resource files and discovery under local-cluster mode *** FAILED *** java.util.concurrent.TimeoutException: Can't find 1 executors before 10000 milliseconds elapsed ...... The timeout doen't work well before, see [SPARK-7989] and [SPARK-10651]. I can't find the principle of the timeout setting, we set it to 20000, because we found the time is about 13000ms then the second executor(2 required in test) can up on our arm testing instances. I don't know what's the value is appropriate? But I think, the timeout should not be the blocker of tests, right? Increase the timeout won't 'increase' the test time for normal case , just fix the failed tests due to timeout. Or there is any other suggestion?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
