dongjoon-hyun edited a comment on pull request #32983:
URL: https://github.com/apache/spark/pull/32983#issuecomment-864508244
`distribute jars archive` passed in Jenkins.
```
ClientSuite:
...
- distribute jars archive
```
The current UT failure is `YarnClusterSuite` which looks irrelevant.
```
YarnClusterSuite:
- run Spark in yarn-client mode
- run Spark in yarn-cluster mode
- run Spark in yarn-client mode with unmanaged am
- run Spark in yarn-client mode with different configurations, ensuring
redaction *** FAILED ***
The code passed to eventually never returned normally. Attempted 190 times
over 3.0014907111 minutes. Last failure message: handle.getState().isFinal()
was false. (BaseYarnClusterSuite.scala:198)
- run Spark in yarn-cluster mode with different configurations, ensuring
redaction *** FAILED ***
The code passed to eventually never returned normally. Attempted 190 times
over 3.0011775924166666 minutes. Last failure message:
handle.getState().isFinal() was false. (BaseYarnClusterSuite.scala:198)
- yarn-cluster should respect conf overrides in SparkHadoopUtil
(SPARK-16414, SPARK-23630) *** FAILED ***
The code passed to eventually never returned normally. Attempted 190 times
over 3.001122617833333 minutes. Last failure message:
handle.getState().isFinal() was false. (BaseYarnClusterSuite.scala:198)
- run Spark in yarn-client mode with additional jar *** FAILED ***
The code passed to eventually never returned normally. Attempted 190 times
over 3.001084003683333 minutes. Last failure message:
handle.getState().isFinal() was false. (BaseYarnClusterSuite.scala:198)
```
Locally, `YarnClusterSuite` passes like the following.
```
[info] YarnClusterSuite:
[info] - run Spark in yarn-client mode (8 seconds, 259 milliseconds)
[info] - run Spark in yarn-cluster mode (10 seconds, 96 milliseconds)
[info] - run Spark in yarn-client mode with unmanaged am (7 seconds, 96
milliseconds)
[info] - run Spark in yarn-client mode with different configurations,
ensuring redaction (8 seconds, 92 milliseconds)
[info] - run Spark in yarn-cluster mode with different configurations,
ensuring redaction (9 seconds, 112 milliseconds)
[info] - yarn-cluster should respect conf overrides in SparkHadoopUtil
(SPARK-16414, SPARK-23630) (9 seconds, 110 milliseconds)
[info] - run Spark in yarn-client mode with additional jar (7 seconds, 115
milliseconds)
[info] - run Spark in yarn-cluster mode with additional jar (10 seconds, 94
milliseconds)
[info] - run Spark in yarn-cluster mode unsuccessfully (6 seconds, 121
milliseconds)
[info] - run Spark in yarn-cluster mode failure after sc initialized (15
seconds, 122 milliseconds)
[info] - run Python application in yarn-client mode (9 seconds, 123
milliseconds)
[info] - run Python application in yarn-cluster mode (10 seconds, 128
milliseconds)
[info] - run Python application in yarn-cluster mode using
spark.yarn.appMasterEnv to override local envvar (10 seconds, 123 milliseconds)
[info] - user class path first in client mode (8 seconds, 104 milliseconds)
[info] - user class path first in cluster mode (9 seconds, 112 milliseconds)
[info] - monitor app using launcher library (5 seconds, 170 milliseconds)
[info] - running Spark in yarn-cluster mode displays driver log links (10
seconds, 110 milliseconds)
[info] - timeout to get SparkContext in cluster mode triggers failure (11
seconds, 107 milliseconds)
[info] - executor env overwrite AM env in client mode (8 seconds, 111
milliseconds)
[info] - executor env overwrite AM env in cluster mode (9 seconds, 112
milliseconds)
[info] - SPARK-34472: ivySettings file with no scheme or file:// scheme
should be localized on driver in cluster mode (17 seconds, 221 milliseconds)
[info] - SPARK-34472: ivySettings file with no scheme or file:// scheme
should retain user provided path in client mode (14 seconds, 194 milliseconds)
[info] - SPARK-34472: ivySettings file with non-file:// schemes should throw
an error (1 second, 719 milliseconds)
[info] Run completed in 3 minutes, 59 seconds.
[info] Total number of tests run: 23
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 23, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 245 s (04:05), completed Jun 19, 2021 11:51:30 PM
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
