[
https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791270#comment-14791270
]
Rohini Palaniswamy commented on PIG-4677:
-----------------------------------------
[~mitdesai],
checkStopOnFailure currently throws an exception which makes it exit early.
So it ends up skipping cleanupOnFailure, printing "Job Stats" information, etc.
i.e all code starting from
MRScriptState.get().emitProgressUpdatedNotification(100);.
So instead of throwing exception and exiting early and relying on system
shutdown hook to kill the remaining jobs, you will have to call
failJob(message) on JobControl.getReadyJobsList() and
JobControl.getRunningJobList() in checkStopOnFailure. That will kill all jobs
and will then follow the regular code path.
> Display failure information on stop on failure
> ----------------------------------------------
>
> Key: PIG-4677
> URL: https://issues.apache.org/jira/browse/PIG-4677
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Mit Desai
> Assignee: Mit Desai
> Attachments: PIG-4677.patch
>
>
> When stop on failure option is specified, pig abruptly exits without
> displaying any job stats or failed job information which it usually does in
> case of failures.
> {code}
> 2015-06-04 20:35:38,170 [uber-SubtaskRunner] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 9% complete
> 2015-06-04 20:35:38,171 [uber-SubtaskRunner] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Running jobs are
> [job_1428329756093_3741748,job_1428329756093_3741752,job_1428329756093_3741753,job_1428329756093_3741754,job_1428329756093_3741756]
> 2015-06-04 20:35:40,201 [uber-SubtaskRunner] ERROR
> org.apache.pig.tools.grunt.Grunt - ERROR 6017: Job failed!
> Hadoop Job IDs executed by Pig:
> job_1428329756093_3739816,job_1428329756093_3741752,job_1428329756093_3739814,job_1428329756093_3741748,job_1428329756093_3741756,job_1428329756093_3741753,job_1428329756093_3741754
> <<< Invocation of Main class completed <<<
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
