Hitesh Shah commented on TEZ-3271:

Assuming that the following recovery case was tested: 

  - V1 connected with V2 
  - V1 completes with failures 
  - AM killed when V2 was running with some tasks already launched 

+1 if the above test was manually done.  

> Provide mapreduce failures.maxpercent equivalent
> ------------------------------------------------
>                 Key: TEZ-3271
>                 URL: https://issues.apache.org/jira/browse/TEZ-3271
>             Project: Apache Tez
>          Issue Type: New Feature
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>         Attachments: Succeeded with Failures.png, TEZ-3271.1.patch, 
> TEZ-3271.10.patch, TEZ-3271.2.patch, TEZ-3271.3.patch, TEZ-3271.4.patch, 
> TEZ-3271.5.patch, TEZ-3271.6.patch, TEZ-3271.7.patch, TEZ-3271.8.patch, 
> TEZ-3271.9.patch
> There is a certain category of work that need not have 100% of tasks succeed 
> to cause the work to be considered a success. To meet that end, I propose we 
> provide a tez equivalent of mapreduce.map.failures.maxpercent and 
> mapreduce.reduce.failures.maxpercent. In this way a vertex will be considered 
> a success if the number of failures is below a configured threshold.

This message was sent by Atlassian JIRA

Reply via email to