I've just have the same problem. I'm using
<pre> $SPARK_HOME/bin/spark-submit --master yarn --deploy-mode client $JOBJAR --class $JOBCLASS </pre> It's really strange, because the log shows that <pre> 14/07/22 16:16:58 INFO ui.SparkUI: Started SparkUI at http://k1227.mzhen.cn:4040 14/07/22 16:16:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/07/22 16:16:58 INFO spark.SparkContext: Added JAR /home/workspace/ci-demo/target/scala-2.10/SemiData-CIDemo-Library-assembly-0.1.jar at http://192.168.7.37:53050/jars/SemiData-CIDemo-Library-assembly-0.1.jar with timestamp 1406017018666 14/07/22 16:16:58 INFO cluster.YarnClusterScheduler: Created YarnClusterScheduler 14/07/22 16:16:58 INFO yarn.ApplicationMaster$$anon$1: Adding shutdown hook for context org.apache.spark.SparkContext@41ecfc8c </pre> Why cluster.YarnClusterScheduler start? where's the Client? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Why-spark-submit-command-hangs-tp10308p10392.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
