[
https://issues.apache.org/jira/browse/TEZ-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated TEZ-3722:
-------------------------
Attachment: TEZ-3722.patch
Here is the draft patch. Applications will first get the configuration object
created by Tez and set properties on the configuration object. Tez will be able
to create the record writer based on the configuration.
> Have MultiMROutput support different configurations for different writers
> -------------------------------------------------------------------------
>
> Key: TEZ-3722
> URL: https://issues.apache.org/jira/browse/TEZ-3722
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ming Ma
> Attachments: TEZ-3722.patch
>
>
> TEZ-3215 added the support for MultiMROutput so that a task can write its
> output to different HDFS files depending on the data. Internally
> MultiMROutput creates different writers keyed by the path. All writers use
> the same configuration.
> We have use cases that different writers need to have different
> configurations, it can be used to specify different output formats, or
> different configuration values for the same output format. So it will be
> useful to allow applications to specify different configuration for different
> writers.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
