Re: PIG performance

[Prashanth Pappu]

Yes, the same queries were substantially slower with hadoop 1.17 and the
latest svn of PIG (compared to hadoop1.16 and svn 653894).

It is hard for me to copy the exact query as there is a lot of context but I
zeroed it down to cogroup statements. I can try and create an example. But I
wanted to check if there is a specific svn version that others use with
hadoop1.17. Or does everyone use top of svn trunk?
Because upgrading from hadoop1.16 and older svn version to latest svn
version did degrade the performance quite a bit.

Prashanth

On Wed, Jun 4, 2008 at 10:51 AM, Olga Natkovich <[EMAIL PROTECTED]> wrote:

> Do you mean that the same query ran faster with some previous code you
> ran? Which code was that?
>
> Olga
>
> > -----Original Message-----
> > From: [EMAIL PROTECTED]
> > [EMAIL PROTECTED] On Behalf Of Prashanth Pappu
> > Sent: Tuesday, June 03, 2008 5:00 PM
> > To: pig-user@incubator.apache.org
> > Subject: PIG performance
> >
> > I just upgraded my PIG src to top of svn and see really poor
> > performance with group and cogroup queries.
> >
> > Is there a recommended svn version to be used with hadoop 1.17?
> >
> > Prashanth
> >
>