Re: unsubscribe

[Derek Schoettle]

Unsubscribe

 On Sep 6, 2014, at 7:48 AM, Murali Raju murali.r...@infrastacks.com
wrote:

Re: Spark scheduling with Capacity scheduler

[Derek Schoettle]

unsubscribe



From:   Matei Zaharia matei.zaha...@gmail.com
To: user@spark.apache.org
Date:   07/17/2014 12:41 PM
Subject:Re: Spark scheduling with Capacity scheduler



It's possible using the --queue argument of spark-submit. Unfortunately 
this is not documented on 
http://spark.apache.org/docs/latest/running-on-yarn.html but it appears if 
you just type spark-submit --help or spark-submit with no arguments.

Matei

On Jul 17, 2014, at 2:33 AM, Konstantin Kudryavtsev 
kudryavtsev.konstan...@gmail.com wrote:

 Hi all,
 
 I'm using HDP 2.0, YARN. I'm running both MapReduce and Spark jobs on 
this cluster, is it possible somehow use Capacity scheduler for Spark jobs 
management as well as MR jobs? I mean, I'm able to send MR job to specific 
queue, may I do the same with Spark job?
 thank you in advance
 
 Thank you,
 Konstantin Kudryavtsev

Re: ETL and workflow management on Spark

[Derek Schoettle]

unsubscribe



From:   William Kang weliam.cl...@gmail.com
To: user@spark.apache.org
Date:   05/22/2014 10:50 AM
Subject:ETL and workflow management on Spark



Hi,
We are moving into adopting the full stack of Spark. So far, we have used
Shark to do some ETL work, which is not bad but is not prefect either. We
ended writing UDF and UDGF, UDAF that can be avoided if we could use Pig.

Do you have any suggestions with the ETL solution in Spark stack?

And did any one have a working work flow management solution with Spark?

Many thanks.


Cao