problem!
Date: Tue, 27 Oct 2009 23:40:43 -0800
I mean hadoop's local mode not pig's own local mode
-Original Message-
From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com]
Sent: 2009年10月26日 6:33
To: pig-dev@hadoop.apache.org; pig-dev@hadoop.apache.org
Subject: RE: Custom Loadfunc problem
Subject: Re: Custom Loadfunc problem!
From: dvrya...@gmail.com
To: pig-dev@hadoop.apache.org
Richard,
I would strongly advise you against trying to mess with PigInputFormat
and JobControlCompiler. We know that slicers work (after all, people
manage to write hbase loaders and such). Plus the whole
I mean hadoop's local mode not pig's own local mode
-Original Message-
From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com]
Sent: 2009年10月26日 6:33
To: pig-dev@hadoop.apache.org; pig-dev@hadoop.apache.org
Subject: RE: Custom Loadfunc problem!
Jeff,
Slicers dont work in local mode
executed?
Since Pig outputs the JobConf to a jar file, it is rather difficult to debug.
Is there any way that I can expose more information?
Thanks,
Richard
Date: Mon, 26 Oct 2009 11:02:04 +0800
Subject: Re: Custom Loadfunc problem!
From: zjf...@gmail.com
To: pig-dev@hadoop.apache.org
...@hotmail.com]
Sent: 2009年10月26日 0:43
To: pig-dev@hadoop.apache.org
Subject: RE: Custom Loadfunc problem!
Hi,
Btw, my program works with ILLUSTRATE but not with DUMP or STORE. It could
be a problem of the slicer or POLoad? Please enlighten me.
Thanks,
Richard
Date: Mon, 26 Oct 2009 11:02
: zjffdu zjf...@gmail.com
To: pig-dev@hadoop.apache.org
Sent: 10/27/2009 1:45 AM
Subject: RE: Custom Loadfunc problem!
Illustrate will not execute the job, while dump and store will execute it.
So I think there must be something wrong with your custom slicer. I suggest
you set breakpoint in your
Subject: RE: Custom Loadfunc problem!
Date: Mon, 26 Oct 2009 10:33:21 -0400
To: pig-dev@hadoop.apache.org; pig-dev@hadoop.apache.org
Jeff,
Slicers dont work in local mode, there is an ancient ticket for that on the
Jira.
Richard -- hard to say whats going on without more code. Think you can
really appreciate your help!
Thanks,
Richard
From: dvrya...@gmail.com
Subject: RE: Custom Loadfunc problem!
Date: Mon, 26 Oct 2009 10:33:21 -0400
To: pig-dev@hadoop.apache.org; pig-dev@hadoop.apache.org
Jeff,
Slicers dont work in local mode, there is an ancient ticket
{
os.writeInt(partitionIndex);
os.writeUTF(path);
}
}
Thanks,
Richard
Date: Mon, 26 Oct 2009 16:15:53 -0400
Subject: Re: Custom Loadfunc problem!
From: dvrya...@gmail.com
To: pig-dev@hadoop.apache.org
Do you get any of your Log messages to come out, or none at all
Hi Richard,
I am not sure what's your problem, but I suggest you can debug your program
in pig's local mode.
And you can even debug it in pig's mapreduce mode locally
Jeff zhang
2009/10/25 RichardGUO Fei gladiato...@hotmail.com
Hi,
I implemented a custom loadfunc class to read data
10 matches
Mail list logo
