Re: Spark SQL performance issue.

2015-04-23 Thread Arush Kharbanda
015 17:12, "Nikolay Tikhonov" >> wrote: >> >>> Hi, >>> I have Spark SQL performance issue. My code contains a simple JavaBean: >>> >>> public class Person implements Externalizable { >>> private int id; >>>

Re: Spark SQL performance issue.

2015-04-23 Thread Nikolay Tikhonov
gt; Quick questions: why are you cache both rdd and table? > Which stage of job is slow? > On 23 Apr 2015 17:12, "Nikolay Tikhonov" > wrote: > >> Hi, >> I have Spark SQL performance issue. My code contains a simple JavaBean: >> >> public class Perso

Re: Spark SQL performance issue.

2015-04-23 Thread ayan guha
Quick questions: why are you cache both rdd and table? Which stage of job is slow? On 23 Apr 2015 17:12, "Nikolay Tikhonov" wrote: > Hi, > I have Spark SQL performance issue. My code contains a simple JavaBean: > > public class Person implements Externalizable { &g

Spark SQL performance issue.

2015-04-23 Thread Nikolay Tikhonov
Hi, I have Spark SQL performance issue. My code contains a simple JavaBean: public class Person implements Externalizable { private int id; private String name; private double salary; } Apply a schema to an RDD and register table

Spark SQL performance issue.

2015-04-22 Thread Nikolay Tikhonov
Hi, I have Spark SQL performance issue. My code contains a simple JavaBean: public class Person implements Externalizable { > private int id; > private String name; > private double salary; > > } > Apply a schema to an RDD and register ta