[jira] [Commented] (BEAM-980) Document how to configure the DAG created by Apex Runner

2016-12-20 Thread Thomas Weise (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764783#comment-15764783
 ] 

Thomas Weise commented on BEAM-980:
---

The runner should probably have an option to specify a configuration file so 
that users can tune the execution attributes similar to what they can do when 
launching through the Apex CLI.

https://github.com/apache/incubator-beam/blob/release-0.4.0-incubating/runners/apex/src/main/java/org/apache/beam/runners/apex/ApexRunner.java#L158



> Document how to configure the DAG created by Apex Runner
> 
>
> Key: BEAM-980
> URL: https://issues.apache.org/jira/browse/BEAM-980
> Project: Beam
>  Issue Type: Task
>  Components: runner-apex
>Reporter: Thomas Weise
>Assignee: Sandeep Deshmukh
>
> The Beam pipeline is translated to an Apex DAG of operators that have names 
> that are derived from the transforms. In case of composite transforms those 
> look like path names. Apex lets the user configure things like memory, 
> vcores, parallelism through properties/attributes that reference the operator 
> names. The configuration approach needs to be documented and supplemented 
> with an example.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (BEAM-980) Document how to configure the DAG created by Apex Runner

2016-11-24 Thread Thomas Weise (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694643#comment-15694643
 ] 

Thomas Weise commented on BEAM-980:
---

[~sandeepdeshmukh] can you take this up?

> Document how to configure the DAG created by Apex Runner
> 
>
> Key: BEAM-980
> URL: https://issues.apache.org/jira/browse/BEAM-980
> Project: Beam
>  Issue Type: Task
>  Components: runner-apex
>Reporter: Thomas Weise
>
> The Beam pipeline is translated to an Apex DAG of operators that have names 
> that are derived from the transforms. In case of composite transforms those 
> look like path names. Apex lets the user configure things like memory, 
> vcores, parallelism through properties/attributes that reference the operator 
> names. The configuration approach needs to be documented and supplemented 
> with an example.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)