Re: UDFContext NULL JobConf

2013-10-31 Thread Henning Kropp
Sure, just did https://issues.apache.org/jira/browse/PIG-3554 Kind regards 2013/10/30 Cheolsoo Park piaozhe...@gmail.com Indeed. Do you mind filing a jira? https://issues.apache.org/jira/browse/PIG On Wed, Oct 30, 2013 at 11:34 AM, Henning Kropp henning.kr...@gmail.com wrote: Wow, I

simple pig logic

2013-10-31 Thread jamal sasha
Hi, I have two datasets.. main_data.txt {id:foo, some_field:12354, score:0} {id:foobar, some_field:12354, score:0} score_data.txt {id:foo, score:1} {id:foobar,score:20} So in main_data.. score is initialized to 0.. Also.. main_data and score_data have some ids in common.. For the ids

UDFContext NULL JobConf

2013-10-31 Thread Henning Kropp
Hi, in my UDF (Java) the following code throws and NPE, when executed in -x mapred mode: Configuration jobConf = UDFContext.getUDFContext().getJobConf(); System.err.println(jobConf.toString()); I did not find any useful information as why my JobConf is always null. All I find is that this is

Re: simple pig logic

2013-10-31 Thread Pradeep Gollakota
If I understood your question correctly, given the following input: main_data.txt {id: foo, some_field: 12354, score: 0} {id: foobar, some_field: 12354, score: 0} {id: baz, some_field: 12345, score: 0} score_data.txt {id: foo, score: 1} {id: foobar, score: 20} you want the following output