dongjoon-hyun commented on PR #44127:
URL: https://github.com/apache/spark/pull/44127#issuecomment-1849123594
BTW, what did you mean by this, @sadikovi ?
> Can be reproduced by running MasterSuite.
When I run it, it passes all tests as of today.
```
$ build/sbt "core/testOnly *.MasterSuite"
...
[info] MasterSuite:
[info] - can use a custom recovery mode factory (409 milliseconds)
[info] - master correctly recover the application (59 milliseconds)
[info] - SPARK-46205: Recovery with Kryo Serializer (28 milliseconds)
[info] - SPARK-46216: Recovery without compression (21 milliseconds)
[info] - SPARK-46216: Recovery with compression (21 milliseconds)
[info] - SPARK-46258: Recovery with RocksDB (335 milliseconds)
[info] - master/worker web ui available (213 milliseconds)
[info] - master/worker web ui available with reverseProxy (30 seconds, 120
milliseconds)
[info] - master/worker web ui available behind front-end reverseProxy (30
seconds, 110 milliseconds)
[info] - basic scheduling - spread out (41 milliseconds)
[info] - basic scheduling - no spread out (15 milliseconds)
[info] - basic scheduling with more memory - spread out (10 milliseconds)
[info] - basic scheduling with more memory - no spread out (8 milliseconds)
[info] - scheduling with max cores - spread out (9 milliseconds)
[info] - scheduling with max cores - no spread out (8 milliseconds)
[info] - scheduling with cores per executor - spread out (8 milliseconds)
[info] - scheduling with cores per executor - no spread out (9 milliseconds)
[info] - scheduling with cores per executor AND max cores - spread out (14
milliseconds)
[info] - scheduling with cores per executor AND max cores - no spread out (8
milliseconds)
[info] - scheduling with executor limit - spread out (8 milliseconds)
[info] - scheduling with executor limit - no spread out (7 milliseconds)
[info] - scheduling with executor limit AND max cores - spread out (7
milliseconds)
[info] - scheduling with executor limit AND max cores - no spread out (7
milliseconds)
[info] - scheduling with executor limit AND cores per executor - spread out
(7 milliseconds)
[info] - scheduling with executor limit AND cores per executor - no spread
out (7 milliseconds)
[info] - scheduling with executor limit AND cores per executor AND max cores
- spread out (8 milliseconds)
[info] - scheduling with executor limit AND cores per executor AND max cores
- no spread out (7 milliseconds)
[info] - scheduling for app with multiple resource profiles (46 milliseconds)
[info] - scheduling for app with multiple resource profiles with max cores
(41 milliseconds)
[info] - SPARK-45174: scheduling with max drivers (9 milliseconds)
[info] - SPARK-13604: Master should ask Worker kill unknown executors and
drivers (21 milliseconds)
[info] - SPARK-20529: Master should reply the address received from worker
(17 milliseconds)
[info] - SPARK-27510: Master should avoid dead loop while launching executor
failed in Worker (32 milliseconds)
[info] - All workers on a host should be decommissioned (26 milliseconds)
[info] - No workers should be decommissioned with invalid host (24
milliseconds)
[info] - Only worker on host should be decommissioned (18 milliseconds)
[info] - SPARK-19900: there should be a corresponding driver for the app
after relaunching driver (2 seconds, 55 milliseconds
[info] - assign/recycle resources to/from driver (34 milliseconds)
[info] - assign/recycle resources to/from executor (28 milliseconds)
[info] - resource description with multiple resource profiles (1 millisecond)
[info] - SPARK-45753: Support driver id pattern (7 milliseconds)
[info] - SPARK-45753: Prevent invalid driver id patterns (6 milliseconds)
[info] - SPARK-45754: Support app id pattern (6 milliseconds)
[info] - SPARK-45754: Prevent invalid app id patterns (5 milliseconds)
[info] - SPARK-45785: Rotate app num with modulo operation (75 milliseconds)
[info] - SPARK-45756: Use appName for appId (9 milliseconds)
[info] Run completed in 1 minute, 5 seconds.
[info] Total number of tests run: 46
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 46, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 92 s (01:32), completed Dec 10, 2023, 3:24:41 PM
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
