Re: Yarn-client mode and standalone-client mode hang during job start

2014-06-17 Thread Jianshi Huang
For standalone-cluster mode, there's a scala.MatchError. Also it looks like the --jars configurations are not passed to the driver/worker node? (also copying from file:/path doesn't seem correct, shouldn't it copy form http://master/path ?) ... 14/06/17 04:15:30 INFO Worker: Asked to launch

Re: Yarn-client mode and standalone-client mode hang during job start

2014-06-17 Thread Andrew Or
Standalone-client mode is not officially supported at the moment. For standalone-cluster and yarn-client modes, however, they should work. For both modes, are you running spark-submit from within the cluster, or outside of it? If the latter, could you try running it from within the cluster and

Re: Yarn-client mode and standalone-client mode hang during job start

2014-06-17 Thread Jianshi Huang
Hi Andrew, I submitted that within the cluster. Looks like the standalone-cluster mode didn't put the jars to its http server, and passed the file:/... to the driver node. That's why the driver node couldn't find the jars. However, I copied my files to all slaves, it still didn't work, see my