[ 
https://issues.apache.org/jira/browse/TEZ-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13930598#comment-13930598
 ] 

Siddharth Seth commented on TEZ-698:
------------------------------------

I'd go with option 2 as well - move everything require to configure an Input / 
Output into the Input / Output itself. Each will likely have a local Config 
specific class which allows setting up parameters.
One thing to consider is related Inputs - e.g. LocalMergedInput is equivalent 
to ShuffledMergedInput - but with a a different transport mechanism. A good 
part of the configuration will be shared.

> Make it easy to create and configure 
> MRInput/MROutput/ShuffleInput/SortedOutput
> -------------------------------------------------------------------------------
>
>                 Key: TEZ-698
>                 URL: https://issues.apache.org/jira/browse/TEZ-698
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>
> We have moved away from MR and its not necessary for anyone to write mappers 
> and reducers or to configure them. But MR input and output and Shuffle 
> related inputs/outputs. Currently we have to invoke a host of methods to 
> configure them. If we can have a single API to make these configs then it 
> would really help. Secondly for IO pairs like ShuffleInput/SortedOutput, 
> their configs are related (KV types e.g.) So it maybe useful to have a 
> combined API that generates configs for both in a single API.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to