dongjoon-hyun commented on pull request #35141: URL: https://github.com/apache/spark/pull/35141#issuecomment-1007867336
Thank you, @viirya . The following is the reproducer in Java 17/Maven/AppleSilicon combination. Java 17/SBT/AppleSilicon works fine without this issue. ``` $ build/mvn -Dtest=none -DwildcardSuites=org.apache.spark.deploy.SparkSubmitSuite test ... SparkSubmitSuite: - prints usage on empty input - prints usage with only --help - prints error with unrecognized options - handle binary specified but not class - handles arguments with --key=val - handles arguments to user program - handles arguments to user program with name collision - print the right queue name - SPARK-24241: do not fail fast if executor num is 0 when dynamic allocation is enabled - specify deploy mode through configuration - handles YARN cluster mode - handles YARN client mode - SPARK-33530: handles standalone mode with archives - handles standalone cluster mode - handles legacy standalone cluster mode - handles standalone client mode - handles mesos client mode - handles k8s cluster mode - automatically sets mainClass if primary resource is S3 JAR in client mode - automatically sets mainClass if primary resource is S3 JAR in cluster mode - error informatively when mainClass isn't set and S3 JAR doesn't exist - handles confs with flag equivalents - SPARK-21568 ConsoleProgressBar should be enabled only in shells 2022-01-07 16:54:31.508 - stderr> SLF4J: Class path contains multiple SLF4J bindings. 2022-01-07 16:54:31.508 - stderr> SLF4J: Found binding in [jar:file:/Users/dongjoon/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-01-07 16:54:31.508 - stderr> SLF4J: Found binding in [jar:file:/Users/dongjoon/.m2/repository/org/apache/logging/log4j/log4j-slf4j-impl/2.17.1/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-01-07 16:54:31.509 - stderr> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-01-07 16:54:31.509 - stderr> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2022-01-07 16:54:32.659 - stderr> Exception in thread "Executor task launch worker-0" java.lang.NoSuchFieldError: mdc 2022-01-07 16:54:32.659 - stderr> at org.apache.log4j.MDCFriend.fixForJava9(MDCFriend.java:11) 2022-01-07 16:54:32.659 - stderr> at org.slf4j.impl.Log4jMDCAdapter.<clinit>(Log4jMDCAdapter.java:38) 2022-01-07 16:54:32.659 - stderr> at org.slf4j.impl.StaticMDCBinder.getMDCA(StaticMDCBinder.java:59) 2022-01-07 16:54:32.659 - stderr> at org.slf4j.MDC.bwCompatibleGetMDCAdapterFromBinder(MDC.java:99) 2022-01-07 16:54:32.659 - stderr> at org.slf4j.MDC.<clinit>(MDC.java:108) 2022-01-07 16:54:32.659 - stderr> at org.apache.spark.executor.Executor.org$apache$spark$executor$Executor$$setMDCForTask(Executor.scala:750) 2022-01-07 16:54:32.659 - stderr> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:441) 2022-01-07 16:54:32.659 - stderr> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-01-07 16:54:32.659 - stderr> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-01-07 16:54:32.659 - stderr> at java.base/java.lang.Thread.run(Thread.java:833) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
