[
https://issues.apache.org/jira/browse/TEZ-1233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308059#comment-14308059
]
Siddharth Seth commented on TEZ-1233:
-------------------------------------
Not very sure how prefixes can be used - especially if the property applies at
multiple levels. e.g. num_attempts for DAG, overwritten by num_attempts by
vertex. Not sure if we'll have properties which can only be specified at a
vertex level.
For the runtime layer - we setup allowed config parameters in maps (see
TezRuntimeConfiguration and any of the Inputs / Outputs). Annotations couldn't
be used there since the properties are used by modules which
TezRuntimeConfiguration is not aware of. Otherwise, annotations seems like a
nice way to achieve this.
> Allow configuration of framework parameters per vertex
> ------------------------------------------------------
>
> Key: TEZ-1233
> URL: https://issues.apache.org/jira/browse/TEZ-1233
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Jeff Zhang
>
> Currently, configuration properties specific in AMConfiguration are used to
> configure tasks - e.g. memory configs, process tree, etc. These should be
> configurable at a Vertex level.
> Also, tasks end up reading these configs from the dist cache each time -
> would be simpler to send over the wire as part of the TaskSpec.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
