Submit Spark driver on Yarn Cluster in client mode

Hi, I want to submit my spark program from my machine on a YARN Cluster in yarn client mode. How to specify al l the required details through SPARK submitter. Please provide me some details. -Naveen.

Store kmeans model

Dear all, How can one save a kmeans model after training ? Best, Jao

Re: Spark serialization issues with third-party libraries

Thanks Arush! Your example is nice and easy to understand. I am implementing it through Java though. Jatin - Novice Big Data Programmer -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-serialization-issues-with-third-party-libraries-tp19454p19624.h

re: How to incrementally compile spark examples using mvn

Thank you, Marcelo and Sean, "mvn install" is a good answer for my demands. -邮件原件- 发件人: Marcelo Vanzin [mailto:van...@cloudera.com] 发送时间: 2014年11月21日 1:47 收件人: yiming zhang 抄送: Sean Owen; user@spark.apache.org 主题: Re: How to incrementally compile spark examples using mvn Hi Yiming, On

Re: Issues about running on client in standalone mode

How are you submitting the job? Thanks Best Regards On Mon, Nov 24, 2014 at 3:02 PM, LinQili wrote: > Hi all: > I deployed a spark client in my own machine. I put SPARK in path:` > /home/somebody/spark`, and the cluster's worker spark home path is > `/home/spark/spark` . > While I launched the

Fwd: 1gb file processing...task doesn't launch on all the node...Unseen exception

Hi, I tried with try catch blocks. Infact, inside mapPartitionsWithIndex, method is invoked which does the operation. I put the operations inside the function in try...catch block but thats of no use...still the error persists. Even I commented all the operations and a simple print statement insi

Issues about running on client in standalone mode

Hi all:I deployed a spark client in my own machine. I put SPARK in path:` /home/somebody/spark`, and the cluster's worker spark home path is `/home/spark/spark` .While I launched the jar, it shows that: ` AppClient$ClientActor: Executor updated: app-20141124170955-11088/12 is now FAILED (java.i

Re: Spark serialization issues with third-party libraries

Hi You can see my code here . Its a POC to implement UIMA on spark https://bitbucket.org/SigmoidDev/uimaspark https://bitbucket.org/SigmoidDev/uimaspark/src/8476fdf16d84d0f517cce45a8bc1bd3410927464/UIMASpark/src/main/scala/ *UIMAProcessor.scala*?at=master this is the class where the major part

<    1   2