[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252796#comment-13252796
 ] 

Robert Joseph Evans commented on MAPREDUCE-4128:
------------------------------------------------

I am not an expert on Avro, so I really don't know why it is not handling the 
schema thing better.  The JobHistory files are also AVRO JSON, so I am really 
confused why it would blow up so badly.  In either case I think you do need to 
handle the null for the ID.  That is because there are likely to be older job 
history files sitting around, and we don't want to crash if they are read in. 
                
> AM Recovery expects all attempts of a completed task to also be completed.
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4128
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 3.0.0
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>             Fix For: 3.0.0
>
>         Attachments: MAPREDUCE-4128-1.patch, MAPREDUCE-4128-2.patch, 
> MAPREDUCE-4128.patch
>
>
> The AM seems to assume that all attempts of a completed task (from a previous 
> AM incarnation) would also be completed. There is at least one case in which 
> this does not hold. Case being cancellation of a completed task resulting in 
> a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to