[
https://issues.apache.org/jira/browse/BEAM-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15843565#comment-15843565
]
Thomas Weise commented on BEAM-980:
-----------------------------------
Added pipeline option to specify a configuration properties file to control the
Apex operator attributes (memory, vcores etc.). There is also a default
classpath resource lookup ("/beam-runners-apex.properties") that allows the
pipeline author to package the file with the jar to have reasonable defaults in
absence of additional runner command line options.
> Ability to configure the DAG created by Apex Runner
> ---------------------------------------------------
>
> Key: BEAM-980
> URL: https://issues.apache.org/jira/browse/BEAM-980
> Project: Beam
> Issue Type: Task
> Components: runner-apex
> Reporter: Thomas Weise
> Assignee: Thomas Weise
> Fix For: 0.6.0
>
>
> The Beam pipeline is translated to an Apex DAG of operators that have names
> that are derived from the transforms. In case of composite transforms those
> look like path names. Apex lets the user configure things like memory,
> vcores, parallelism through properties/attributes that reference the operator
> names. The configuration approach needs to be documented and supplemented
> with an example.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
