Re: JDK1.8 for spark workers

2017-11-29 Thread KhajaAsmath Mohammed
This didnt work. I tried it but no luck. On Wed, Nov 29, 2017 at 7:49 PM, Vadim Semenov wrote: > You can pass `JAVA_HOME` environment variable > > `spark.executorEnv.JAVA_HOME=/usr/lib/jvm/java-1.8.0` > > On Wed, Nov 29, 2017 at 10:54 AM, KhajaAsmath Mohammed < >

Re: JDK1.8 for spark workers

2017-11-29 Thread Vadim Semenov
You can pass `JAVA_HOME` environment variable `spark.executorEnv.JAVA_HOME=/usr/lib/jvm/java-1.8.0` On Wed, Nov 29, 2017 at 10:54 AM, KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > Hi, > > I am running cloudera version of spark2.1 and our cluster is on JDK1.7. > For some of the

JDK1.8 for spark workers

2017-11-29 Thread KhajaAsmath Mohammed
Hi, I am running cloudera version of spark2.1 and our cluster is on JDK1.7. For some of the libraries, I need JDK1.8, is there a way to set to run Spark worker in JDK1.8 without upgrading . I was able run driver in JDK 1.8 by setting the path but not the workers. 17/11/28 20:22:27 WARN