Santhosh Srinivasan commented on PIG-889:

The issue here is the lack of support for counters within Pig.

The intention of warn method in the PigLogger interface was to allow sources 
within Pig and UDFs  for warning aggregation. Your use of the reporter within 
the logger is not supported. An implementation detail prevents the correct use 
of this interface for load functions. The Hadoop reporter object is provided in 
the getRecordReader, map and reduce calls. For load functions, Pig provides an 
interface and for UDFs, an abstract class. As a result, the logger instance 
cannot be initialized in the loaders till we decide to add a method to support 

Will having the code from PigMapBase.map()  in 
PigInputFormat.java.getRecordReader work for you? 

            PigHadoopLogger pigHadoopLogger = PigHadoopLogger.getInstance();

Note that this is a workaround for your situation. I would highly recommend 
that you move to the use of counters when they are supported.

> Pig can not access reporter of PigHadoopLog in Load Func
> --------------------------------------------------------
>                 Key: PIG-889
>                 URL: https://issues.apache.org/jira/browse/PIG-889
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>    Affects Versions: 0.4.0
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>             Fix For: 0.4.0
>         Attachments: Pig_889_Patch.txt
> I'd like to increment Counter in my own LoadFunc, but it will throw 
> NullPointerException. It seems that the reporter is not initialized.  
> I looked into this problem and find that it need to call 
> PigHadoopLogger.getInstance().setReporter(reporter) in PigInputFormat.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to