Re: How to set driverMemory, driverCores, executorMemory using livy?

2017-12-06 Thread Saisai Shao
You should write as *Spark configuration* like spark.xxx. 2017-12-06 16:23 GMT+08:00 kant kodali : > Does the below code look right? > > new LivyClientBuilder() > .setURI(new URI(livyUrl)) > .setConf("driverMemory", "4g").setConf("executorMemory", > "4g").setConf("driverCores", "4").bui

Re: How to set driverMemory, driverCores, executorMemory using livy?

2017-12-06 Thread kant kodali
Does the below code look right? new LivyClientBuilder() .setURI(new URI(livyUrl)) .setConf("driverMemory", "4g").setConf("executorMemory", "4g").setConf("driverCores", "4").build(); On Wed, Dec 6, 2017 at 12:20 AM, kant kodali wrote: > Thanks much! > > On Wed, Dec 6, 2017 at 12:16 AM,

Re: How to set driverMemory, driverCores, executorMemory using livy?

2017-12-06 Thread kant kodali
Thanks much! On Wed, Dec 6, 2017 at 12:16 AM, Saisai Shao wrote: > Using this API "public LivyClientBuilder setConf(String key, String > value)" to set Spark configurations you wanted. > > 2017-12-06 15:34 GMT+08:00 kant kodali : > >> Hi All, >> >> >> I do see POST /sessions API where I can pas

Re: How to set driverMemory, driverCores, executorMemory using livy?

2017-12-06 Thread Saisai Shao
Using this API "public LivyClientBuilder setConf(String key, String value)" to set Spark configurations you wanted. 2017-12-06 15:34 GMT+08:00 kant kodali : > Hi All, > > > I do see POST /sessions API where I can pass driverMemory, driverCores, > executorMemory as part of the request body but I

How to set driverMemory, driverCores, executorMemory using livy?

2017-12-05 Thread kant kodali
Hi All, I do see POST /sessions API where I can pass driverMemory, driverCores, executorMemory as part of the request body but I am using programmatic API to submit upload the Jar and submit my job so how do I set values for driverMemory, driverCores, executorMemory ? Thanks!