Olga Natkovich
Wed, 04 Jun 2008 12:07:21 -0700
We saw some slowdown in the unit tests but not in our end-to-end tests. Olga > -----Original Message----- > From: [EMAIL PROTECTED] > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu > Sent: Wednesday, June 04, 2008 11:16 AM > To: pig-user@incubator.apache.org > Subject: Re: PIG performance > > Yes, the same queries were substantially slower with hadoop > 1.17 and the latest svn of PIG (compared to hadoop1.16 and > svn 653894). > > It is hard for me to copy the exact query as there is a lot > of context but I zeroed it down to cogroup statements. I can > try and create an example. But I wanted to check if there is > a specific svn version that others use with hadoop1.17. Or > does everyone use top of svn trunk? > Because upgrading from hadoop1.16 and older svn version to > latest svn version did degrade the performance quite a bit. > > Prashanth > > On Wed, Jun 4, 2008 at 10:51 AM, Olga Natkovich > <[EMAIL PROTECTED]> wrote: > > > Do you mean that the same query ran faster with some > previous code you > > ran? Which code was that? > > > > Olga > > > > > -----Original Message----- > > > From: [EMAIL PROTECTED] > > > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu > > > Sent: Tuesday, June 03, 2008 5:00 PM > > > To: pig-user@incubator.apache.org > > > Subject: PIG performance > > > > > > I just upgraded my PIG src to top of svn and see really poor > > > performance with group and cogroup queries. > > > > > > Is there a recommended svn version to be used with hadoop 1.17? > > > > > > Prashanth > > > > > >