[
https://issues.apache.org/jira/browse/BEAM-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076911#comment-16076911
]
ASF GitHub Bot commented on BEAM-2371:
--------------------------------------
GitHub user kennknowles opened a pull request:
https://github.com/apache/beam/pull/3509
[BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`.
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
---
R: @tgroh
This ports the DirectRunner's pipeline replacements to work even after a
pipeline has been serialized and then deserialized, hence somewhat SDK-agnostic.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kennknowles/beam DirectRunner-overrides
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3509.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3509
----
commit 515cd09b9017d13cebd5a4a161743c75a58455b5
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-06T16:24:22Z
Rehydrate PCollections
commit e942c8edec6cbb80122f1bd966490d31f0d8ae9b
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-08T20:46:18Z
Add more utilities to ParDoTranslation
commit 670aaa0ce34bed78e4b35886cf6c84d324738188
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-06T16:24:55Z
Include PCollection in rehydrated PCollectionView
commit b4d1636d109842aada19c7a6582a91f5f16a58cc
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-08T20:44:52Z
Port DirectRunner ParDo overrides to SDK-agnostic APIs
commit 0f0412a520499ea4458575b23f184bd6f8d6fcea
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-08T21:27:02Z
Enable SplittableParDo on rehydrated ParDo transform
commit adb44ad37f1b766f79fa864c67cdf00f25e94d51
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-12T22:11:49Z
Fix misleading comment in TransformHierarchy
commit 312460ad41f2e858dae08605cdc126d217d3630d
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-12T22:12:18Z
Fix null checks in TransformHierarchy
----
> Make Java DirectRunner demonstrate language-agnostic Runner API translation
> wrappers
> ------------------------------------------------------------------------------------
>
> Key: BEAM-2371
> URL: https://issues.apache.org/jira/browse/BEAM-2371
> Project: Beam
> Issue Type: Improvement
> Components: runner-direct
> Reporter: Kenneth Knowles
> Assignee: Kenneth Knowles
>
> This will complete the PoC for runners-core-construction-java and the Runner
> API and show other runners the easy path to executing non-Java pipelines,
> modulo Fn API.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
