[ 
https://issues.apache.org/jira/browse/PIG-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997253#comment-13997253
 ] 

Cheolsoo Park commented on PIG-3739:
------------------------------------

I think it has to do with PIG-3679 that made POUserFunc skip calling UDF for 
null tuples (i.e. all the fields are null).

# From the counter, there were 3 null tuples.
{code}
  SKIP_UDF_CALL_FOR_NULL = 3
+ UDF_WARNING_4          = 19
-----------------------------
  UDF_WARNING_4          = 22
{code}
# Tuples in the test have 3 fields ({{name, age: int, gpa: float}}). If you 
look at TestWarningFunc.java, UDF_WARNING_3 is incremented per field.
{code}
  UDF_WARNING_3 = 10989
- UDF_WARNING_3 = 10980
-----------------------------
                = 9
{code}
The difference is 9, so 9 / 3 = 3 tuples are skipped. This matches #1.

> The Warning_4 e2e test is broken in trunk
> -----------------------------------------
>
>                 Key: PIG-3739
>                 URL: https://issues.apache.org/jira/browse/PIG-3739
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Cheolsoo Park
>            Assignee: Aniket Mokashi
>             Fix For: 0.13.0
>
>
> This is a regression of PIG-2207.
> The Warning_4 e2e test fails because expected warning messages are not 
> printed to stderr. I confirmed that the following lines are present w/o 
> PIG-2207, whereas they are not w/ PIG-2207.
> {code}
> 2014-02-02 04:48:11,211 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning UDF_WARNING_3 10989 time(s).
> 2014-02-02 04:48:11,211 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning UDF_WARNING_4 22 time(s).
> {code}
> Here is the test query-
> {code}
> register ./lib/java/testudf.jar;
> a = load '/user/pig/tests/data/singlefile/studentnulltab10k' as (name, age: 
> int, gpa: float);
> b = foreach a generate org.apache.pig.test.udf.evalfunc.TestWarningFunc(name, 
> age, gpa);
> store b into 
> '/user/pig/out/cheolsoop-1391202001-cmdline.conf-Warning/Warning_4.out';
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to