[
https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mit Desai updated PIG-4677:
---------------------------
Attachment: PIG-4677.3.patch
Thanks for the Review [~rohini]. Updated the patch.
In the ExecException, the message used to be "job_id Job Failed!". I have
changed it to "Some jobs failed. stop.on.failure set true. Stopping execution".
What job failed can now be easily found out by looking at the Script Status
which will look something like this:
{noformat}
Error: org.apache.pig.backend.executionengine.ExecException: ERROR 2055:
Received Error while processing the map plan: 'false
(stdin-org.apache.pig.builtin.PigStreaming/stdout-org.apache.pig.builtin.PigStreaming)'
failed with exit status: 1
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:307)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:274)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
2015-09-20 16:44:56,874 [main] ERROR org.apache.pig.tools.pigstats.PigStats -
ERROR 0: org.apache.pig.backend.executionengine.ExecException: ERROR 2055:
Received Error while processing the map plan: 'false
(stdin-org.apache.pig.builtin.PigStreaming/stdout-org.apache.pig.builtin.PigStreaming)'
failed with exit status: 1
2015-09-20 16:44:56,874 [main] ERROR
org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s)
failed!
2015-09-20 16:44:56,875 [main] INFO
org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.6.0 0.16.0-SNAPSHOT mitdesai 2015-09-20 16:44:38 2015-09-20
16:44:56 STREAMING
Failed!
Failed Jobs:
JobId Alias Feature Message Outputs
job_1442785471589_0001 A,B STREAMING,MAP_ONLY Message: Job failed!
hdfs://localhost:63266/user/mitdesai/bar,
Input(s):
Output(s):
Failed to produce result in "hdfs://localhost:63266/user/mitdesai/bar"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_1442785471589_0001 -> null,
null
2015-09-20 16:44:56,875 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Failed!
2015-09-20 16:44:56,876 [IPC Server handler 8 on 63266] INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit - allowed=true
ugi=mitdesai (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo
src=/user/mitdesai/bar dst=null perm=null proto=rpc
2015-09-20 16:44:56,878 [IPC Server handler 9 on 63266] INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit - allowed=true
ugi=mitdesai (auth:SIMPLE) ip=/127.0.0.1 cmd=delete
src=/user/mitdesai/bar dst=null perm=null proto=rpc
2015-09-20 16:44:56,879 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
6017: stop.on.failure set true. Some jobs failed. Stopping Execution
2015-09-20 16:44:56,879 [main] WARN org.apache.pig.tools.grunt.Grunt - There
is no log file to write to.
2015-09-20 16:44:56,879 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 6017:
stop.on.failure set true. Some jobs failed. Stopping Execution
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:546)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:304)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375){noformat}
> Display failure information on stop on failure
> ----------------------------------------------
>
> Key: PIG-4677
> URL: https://issues.apache.org/jira/browse/PIG-4677
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Mit Desai
> Assignee: Mit Desai
> Attachments: PIG-4677.2.patch, PIG-4677.3.patch, PIG-4677.patch
>
>
> When stop on failure option is specified, pig abruptly exits without
> displaying any job stats or failed job information which it usually does in
> case of failures.
> {code}
> 2015-06-04 20:35:38,170 [uber-SubtaskRunner] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 9% complete
> 2015-06-04 20:35:38,171 [uber-SubtaskRunner] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Running jobs are
> [job_1428329756093_3741748,job_1428329756093_3741752,job_1428329756093_3741753,job_1428329756093_3741754,job_1428329756093_3741756]
> 2015-06-04 20:35:40,201 [uber-SubtaskRunner] ERROR
> org.apache.pig.tools.grunt.Grunt - ERROR 6017: Job failed!
> Hadoop Job IDs executed by Pig:
> job_1428329756093_3739816,job_1428329756093_3741752,job_1428329756093_3739814,job_1428329756093_3741748,job_1428329756093_3741756,job_1428329756093_3741753,job_1428329756093_3741754
> <<< Invocation of Main class completed <<<
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
