RE: dataframe slow down with tungsten turn on

2015-11-05 Thread Cheng, Hao
turn on -- Forwarded message -- From: gen tang mailto:gen.tan...@gmail.com>> Date: Fri, Nov 6, 2015 at 12:14 AM Subject: Re: dataframe slow down with tungsten turn on To: "Cheng, Hao" mailto:hao.ch...@intel.com>> Hi, My application is as follows: 1. crea

RE: dataframe slow down with tungsten turn on

2015-11-04 Thread Cheng, Hao
BTW, 1 min V.S. 2 Hours, seems quite weird, can you provide more information on the ETL work? From: Cheng, Hao [mailto:hao.ch...@intel.com] Sent: Thursday, November 5, 2015 12:56 PM To: gen tang; dev@spark.apache.org Subject: RE: dataframe slow down with tungsten turn on 1.5 has critical

RE: dataframe slow down with tungsten turn on

2015-11-04 Thread Cheng, Hao
1.5 has critical performance / bug issues, you’d better try 1.5.1 or 1.5.2rc version. From: gen tang [mailto:gen.tan...@gmail.com] Sent: Thursday, November 5, 2015 12:43 PM To: dev@spark.apache.org Subject: Fwd: dataframe slow down with tungsten turn on Hi, In fact, I tested the same code with