LuciferYang commented on pull request #34855:
URL: https://github.com/apache/spark/pull/34855#issuecomment-1061022437
> It seems to pass locally. Could you re-trigger the test simply, @sunchao ?
>
> ```
> [info] YarnClusterSuite:
> [info] - run Spark in yarn-client mode (10 seconds, 131 milliseconds)
> [info] - run Spark in yarn-cluster mode (9 seconds, 90 milliseconds)
> [info] - run Spark in yarn-client mode with unmanaged am (8 seconds, 78
milliseconds)
> [info] - run Spark in yarn-client mode with different configurations,
ensuring redaction (10 seconds, 102 milliseconds)
> [info] - run Spark in yarn-cluster mode with different configurations,
ensuring redaction (10 seconds, 96 milliseconds)
> [info] - yarn-cluster should respect conf overrides in SparkHadoopUtil
(SPARK-16414, SPARK-23630) (9 seconds, 116 milliseconds)
> [info] - SPARK-35672: run Spark in yarn-client mode with additional jar
using URI scheme 'local' (10 seconds, 111 milliseconds)
> [info] - SPARK-35672: run Spark in yarn-cluster mode with additional jar
using URI scheme 'local' (9 seconds, 96 milliseconds)
> [info] - SPARK-35672: run Spark in yarn-client mode with additional jar
using URI scheme 'local' and gateway-replacement path (8 seconds, 79
milliseconds)
> [info] - SPARK-35672: run Spark in yarn-cluster mode with additional jar
using URI scheme 'local' and gateway-replacement path (9 seconds, 90
milliseconds)
> [info] - SPARK-35672: run Spark in yarn-cluster mode with additional jar
using URI scheme 'local' and gateway-replacement path containing an environment
variable (9 seconds, 100 milliseconds)
> ...
> ```
I manually test with mvn locally, and there will be UT failed:
```
YarnClusterSuite:
- run Spark in yarn-client mode
- run Spark in yarn-cluster mode
- run Spark in yarn-client mode with unmanaged am
- run Spark in yarn-client mode with different configurations, ensuring
redaction
- run Spark in yarn-cluster mode with different configurations, ensuring
redaction
- yarn-cluster should respect conf overrides in SparkHadoopUtil
(SPARK-16414, SPARK-23630)
- SPARK-35672: run Spark in yarn-client mode with additional jar using URI
scheme 'local'
- SPARK-35672: run Spark in yarn-cluster mode with additional jar using URI
scheme 'local'
- SPARK-35672: run Spark in yarn-client mode with additional jar using URI
scheme 'local' and gateway-replacement path
- SPARK-35672: run Spark in yarn-cluster mode with additional jar using URI
scheme 'local' and gateway-replacement path
- SPARK-35672: run Spark in yarn-cluster mode with additional jar using URI
scheme 'local' and gateway-replacement path containing an environment variable
- SPARK-35672: run Spark in yarn-client mode with additional jar using URI
scheme 'file'
- SPARK-35672: run Spark in yarn-cluster mode with additional jar using URI
scheme 'file'
- run Spark in yarn-cluster mode unsuccessfully
- run Spark in yarn-cluster mode failure after sc initialized
- run Python application in yarn-client mode *** FAILED ***
LOST did not equal FINISHED SLF4J: Class path contains multiple SLF4J
bindings.
SLF4J: Found binding in
[jar:file:/Users/xxx/spark-source/assembly/target/scala-2.12/jars/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/Users/xxx/.m2/repository/org/apache/logging/log4j/log4j-slf4j-impl/2.17.1/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type
[org.apache.logging.slf4j.Log4jLoggerFactory] (BaseYarnClusterSuite.scala:233)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
