---------- Forwarded message ---------- From: Sachin Sabbarwal <[email protected]> Date: Mon, Jul 6, 2015 at 5:34 PM Subject: Same pig script running slower with Tez as compared with run in Mapred mode To: [email protected]
Hello Guys Trying Apache Tez. I've setup to use pig in TEZ mode. I'm running a pig script against i) no data and ii) with some data. In case i) when i run with pig using TEZ mode my pig scripts completes run in ~40secs. Whereas when i run case i) with mapred it takes around 7-8 mins. in case ii) when run with pig using TEZ, same pig script takes around 14-15 mins but with mapred it takes around 10 mins. When i'm running same pig script with production data(which is much more than the data i used here to run case i) and (ii) ) the job takes hours to complete. Hence I'm trying tez to run my pig job in a faster mode. I'm not really sure what i might be missing here. Please help, ask for any further info if required. Thanks -- Sachin Sabbarwal Linkedin: https://www.linkedin.com/profile?viewProfile=&key=95777265 Facebook: facebook.com/sachinsabbarwal Quora: http://www.quora.com/Sachin-Sabbarwal Blog: http://sachinsabbarwal.tumblr.com/ -- Sachin Sabbarwal Linkedin: https://www.linkedin.com/profile?viewProfile=&key=95777265 Facebook: facebook.com/sachinsabbarwal Quora: http://www.quora.com/Sachin-Sabbarwal Blog: http://sachinsabbarwal.tumblr.com/
