Re: PIG performance

[pi song]

I think saying "slow down" is too subjective. When we get performance boost
in most areas, some smaller areas might perform poorer than before.
I saw a Jira issue that discussed about introducing a standard way to
benchmark before but didn't see  any progress.


On Thu, Jun 5, 2008 at 5:05 AM, Olga Natkovich <[EMAIL PROTECTED]> wrote:

> We saw some slowdown in the unit tests but not in our end-to-end tests.
>
> Olga
>
> > -----Original Message-----
> > From: [EMAIL PROTECTED]
> > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu
> > Sent: Wednesday, June 04, 2008 11:16 AM
> > To: pig-user@incubator.apache.org
> > Subject: Re: PIG performance
> >
> > Yes, the same queries were substantially slower with hadoop
> > 1.17 and the latest svn of PIG (compared to hadoop1.16 and
> > svn 653894).
> >
> > It is hard for me to copy the exact query as there is a lot
> > of context but I zeroed it down to cogroup statements. I can
> > try and create an example. But I wanted to check if there is
> > a specific svn version that others use with hadoop1.17. Or
> > does everyone use top of svn trunk?
> > Because upgrading from hadoop1.16 and older svn version to
> > latest svn version did degrade the performance quite a bit.
> >
> > Prashanth
> >
> > On Wed, Jun 4, 2008 at 10:51 AM, Olga Natkovich
> > <[EMAIL PROTECTED]> wrote:
> >
> > > Do you mean that the same query ran faster with some
> > previous code you
> > > ran? Which code was that?
> > >
> > > Olga
> > >
> > > > -----Original Message-----
> > > > From: [EMAIL PROTECTED]
> > > > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu
> > > > Sent: Tuesday, June 03, 2008 5:00 PM
> > > > To: pig-user@incubator.apache.org
> > > > Subject: PIG performance
> > > >
> > > > I just upgraded my PIG src to top of svn and see really poor
> > > > performance with group and cogroup queries.
> > > >
> > > > Is there a recommended svn version to be used with hadoop 1.17?
> > > >
> > > > Prashanth
> > > >
> > >
> >
>