Re: problem for submitting job

2015-06-29 Thread Akhil Das
Cool. On 29 Jun 2015 21:10, "郭谦" wrote: > Akhil Das, > > You give me a new idea to solve the problem. > > Vova provides me a way to solve the problem just before > > Vova Shelgunov > > Sample code for submitting job from any other java app, e.g. servlet: > > http://pastebin.com/X1S28ivJ > > I app

Re: problem for submitting job

2015-06-29 Thread Akhil Das
You can create a SparkContext in your program and run it as a standalone application without using spark-submit. Here's something that will get you started: //Create SparkContext val sconf = new SparkConf() .setMaster("spark://spark-ak-master:7077") .setAppName("Test") .s

problem for submitting job

2015-06-28 Thread 郭谦
HI, I'm a junior user of spark from China. I have a problem about submit spark job right now. I want to submit job from code. In other words ,"How to submit spark job from within java program to yarn cluster without using spark-submit" I've learnt from official site http://spark.apache.