Daniel Dai commented on PIG-1001:

Change the error handling for map-reduce jobs. Changes are:
1. If one job complete fail (If we have only one store and that job fail), then 
we do not start all dependent map-reduce jobs
2. Before, we do not report error message of MR job with temporary store. It is 
possible that we miss the root cause of the entire script. So we instead print 
error message of all MR jobs we kick off. With the change of not starting 
dependent map-reduce jobs, hopefully only the error message of the MR job 
causing the problem printed out.
3. Change the way we report error message when "-F" is on. Before, we only 
report "fail to produce xxxx", now we print out the error message that cause 
the problem.

> Generate more meaningful error message when one input file does not exist
> -------------------------------------------------------------------------
>                 Key: PIG-1001
>                 URL: https://issues.apache.org/jira/browse/PIG-1001
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Daniel Dai
>             Fix For: 0.6.0
>         Attachments: PIG-1001-1.patch
> In the following query, if 2.txt does not exist, 
> a = load '1.txt';
> b = order a by $0;
> c = load '2.txt';
> d = order c by $0;
> e = join b by $0, d by $0;
> dump e;
> Pig throws error message "ERROR 2100: file:/tmp/temp155054664/tmp1144108421 
> does not exist.", Pig should deal with it with the error message "Input file 
> 2.txt not exist" instead of those confusing messages.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to