GitHub user peihe opened a pull request:
https://github.com/apache/beam/pull/3276
Flink runner: support per transform parallelism through PipelineOptions.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`.
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/peihe/incubator-beam configuration-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3276.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3276
----
commit 24367f0def03e7c3a501d44ad2be866b3ba89caf
Author: Pei He <[email protected]>
Date: 2017-05-27T09:06:07Z
Flink runner: specify per transform parallelism through PipelineOptions.
commit 99c7752913db91da0b7c762c4dcf01ee258b5a4b
Author: Pei He <[email protected]>
Date: 2017-06-01T03:08:42Z
Flink runner: infer per transform parallelism in
PipelineTranslationOptimizer.
commit 45d3ea012dd9ec5bc6525abb126e15c7825a77b2
Author: Pei He <[email protected]>
Date: 2017-06-01T03:32:12Z
Flink runner: override the translation context parallelism if
perTransformParallelism is found.
commit 403f89bfb16b38a6b2089f4574938a08fe30802e
Author: Pei He <[email protected]>
Date: 2017-06-01T06:47:15Z
Flink runner: use upStream parallelism for flatmap when translating
GroupByKey and Combine.PerKey.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
