Re: Standalone mode resource allocation questions

2016-07-05 Thread Jacek Laskowski
On Tue, Jul 5, 2016 at 4:18 PM, Jakub Stransky wrote: > 1) Is it possible to configure multiple executors per worker machine? Yes. > Do I understand it correctly that I specify SPARK_WORKER_MEMORY and > SPARK_WORKER_CORES which essentially describes available resources

Standalone mode resource allocation questions

2016-07-05 Thread Jakub Stransky
Hello, I went through Spark documentation and several posts from Cloudera etc and as my background is heavily on Hadoop/YARN there is a little confusion still there. Could someone more experienced clarify please? What I am trying to achieve: - Running cluster in standalone mode version 1.6.1