pig-user  

RE: PIG performance

Olga Natkovich
Wed, 04 Jun 2008 12:07:21 -0700

We saw some slowdown in the unit tests but not in our end-to-end tests.

Olga 

> -----Original Message-----
> From: [EMAIL PROTECTED] 
> [EMAIL PROTECTED] On Behalf Of Prashanth Pappu
> Sent: Wednesday, June 04, 2008 11:16 AM
> To: pig-user@incubator.apache.org
> Subject: Re: PIG performance
> 
> Yes, the same queries were substantially slower with hadoop 
> 1.17 and the latest svn of PIG (compared to hadoop1.16 and 
> svn 653894).
> 
> It is hard for me to copy the exact query as there is a lot 
> of context but I zeroed it down to cogroup statements. I can 
> try and create an example. But I wanted to check if there is 
> a specific svn version that others use with hadoop1.17. Or 
> does everyone use top of svn trunk?
> Because upgrading from hadoop1.16 and older svn version to 
> latest svn version did degrade the performance quite a bit.
> 
> Prashanth
> 
> On Wed, Jun 4, 2008 at 10:51 AM, Olga Natkovich 
> <[EMAIL PROTECTED]> wrote:
> 
> > Do you mean that the same query ran faster with some 
> previous code you 
> > ran? Which code was that?
> >
> > Olga
> >
> > > -----Original Message-----
> > > From: [EMAIL PROTECTED]
> > > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu
> > > Sent: Tuesday, June 03, 2008 5:00 PM
> > > To: pig-user@incubator.apache.org
> > > Subject: PIG performance
> > >
> > > I just upgraded my PIG src to top of svn and see really poor 
> > > performance with group and cogroup queries.
> > >
> > > Is there a recommended svn version to be used with hadoop 1.17?
> > >
> > > Prashanth
> > >
> >
>