[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612128#comment-17612128
]
Yang Jie commented on SPARK-40635:
----------------------------------
{code:java}
Exception message: Cannot run program "bash" (in directory
"/home/runner/work/spark/spark/resource-managers/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/runner/appcache/application_1664721938509_0027/container_1664721938509_0027_02_000001"):
error=7, Argument list too long
22096[info] Stack trace: java.io.IOException: Cannot run program "bash" (in
directory
"/home/runner/work/spark/spark/resource-managers/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/runner/appcache/application_1664721938509_0027/container_1664721938509_0027_02_000001"):
error=7, Argument list too long
22097[info] at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
22098[info] at org.apache.hadoop.util.Shell.runCommand(Shell.java:526)
22099[info] at org.apache.hadoop.util.Shell.run(Shell.java:482)
22100[info] at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
22101[info] at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
22102[info] at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
22103[info] at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
22104[info] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
22105[info] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
22106[info] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
22107[info] at java.lang.Thread.run(Thread.java:750)
22108[info] Caused by: java.io.IOException: error=7, Argument list too long
22109[info] at java.lang.UNIXProcess.forkAndExec(Native Method)
22110[info] at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
22111[info] at java.lang.ProcessImpl.start(ProcessImpl.java:134)
22112[info] at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
22113[info] ... 10 more
22114[info] {code}
> Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
> ------------------------------------------------
>
> Key: SPARK-40635
> URL: https://issues.apache.org/jira/browse/SPARK-40635
> Project: Spark
> Issue Type: Bug
> Components: Tests, YARN
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Priority: Major
>
> [https://github.com/apache/spark/actions/runs/3164718086]
>
> {code:java}
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleAlternateNameConfigWithLevelDBBackendSuite
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleIntegrationWithLevelDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnClusterSuite
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleAuthWithLevelDBBackendSuite
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleAlternateNameConfigWithRocksDBBackendSuite
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleIntegrationWithRocksDBBackendSuite
> [error]
> org.apache.spark.deploy.yarn.YarnShuffleAuthWithRocksDBBackendSuite {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
