[ 
https://issues.apache.org/jira/browse/TEZ-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978767#comment-13978767
 ] 

Bikas Saha commented on TEZ-1062:
---------------------------------

We should first go through all outputs to check if they are MROutput and if 
they need commit. Collect these. If non-empty collection ask for commit 
permission. After that call commit on all collected outputs. If any commit 
throw exception then call abort on all collected outputs.
We can create a SimpleProcessor in tez-runtime-library and 
SimpleProcessorWithMRCommit that derives from SimpleProcessor() in 
tez-mapreduce project.

> Create SimpleProcessor for processors that only need to implement the run 
> method
> --------------------------------------------------------------------------------
>
>                 Key: TEZ-1062
>                 URL: https://issues.apache.org/jira/browse/TEZ-1062
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>            Assignee: Mohammad Kamrul Islam
>         Attachments: TEZ-1062.1.patch
>
>
> The SimpleProcessor could take care of all things like starting input, 
> committing outputs. It would handle no events, since simple processors dont 
> need to handle inputs. Thus the user would only need to implement their 
> custom task logic in a new execute() method.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to