Re: Re: sparksql running slow while joining 2 tables.

2015-05-04 Thread Olivier Girardot
gt; >> but this issue still happens. >> >> >> >> >> Thanks&Best regards! >> 罗辉 San.Luo >> >> - 原始邮件 - >> 发件人:Olivier Girardot >> 收件人:luohui20...@sina.com, user >> 主题:Re: sparksql ru

RE: 回复:Re: sparksql running slow while joining 2 tables.

2015-05-04 Thread Cheng, Hao
Or, have you ever try broadcast join? From: Cheng, Hao [mailto:hao.ch...@intel.com] Sent: Tuesday, May 5, 2015 8:33 AM To: luohui20...@sina.com; Olivier Girardot; user Subject: RE: 回复:Re: sparksql running slow while joining 2 tables. Can you print out the physical plan? EXPLAIN SELECT xxx

RE: 回复:Re: sparksql running slow while joining 2 tables.

2015-05-04 Thread Cheng, Hao
Can you print out the physical plan? EXPLAIN SELECT xxx… From: luohui20...@sina.com [mailto:luohui20...@sina.com] Sent: Monday, May 4, 2015 9:08 PM To: Olivier Girardot; user Subject: 回复:Re: sparksql running slow while joining 2 tables. hi Olivier spark1.3.1, with java1.8.0.45 and add 2 pics

Re: Re: sparksql running slow while joining 2 tables.

2015-05-04 Thread ayan guha
a opts... > > but this issue still happens. > > > > > Thanks&Best regards! > 罗辉 San.Luo > > - 原始邮件 - > 发件人:Olivier Girardot > 收件人:luohui20...@sina.com, user > 主题:Re: sparksql running slow while joining 2 tables. &g

Re: sparksql running slow while joining 2 tables.

2015-05-04 Thread Olivier Girardot
Hi, What is you Spark version ? Regards, Olivier. Le lun. 4 mai 2015 à 11:03, a écrit : > hi guys > > when i am running a sql like "select a.name,a.startpoint,a.endpoint, > a.piece from db a join sample b on (a.name = b.name) where (b.startpoint > > a.startpoint + 25);" I found sparks