[
https://issues.apache.org/jira/browse/BEAM-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022303#comment-16022303
]
ASF GitHub Bot commented on BEAM-2333:
--------------------------------------
GitHub user kennknowles opened a pull request:
https://github.com/apache/beam/pull/3217
[BEAM-2333] Use URN to get RootInputProvider in Java DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`.
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
---
This is built on #3195. It adjusts another registry to be agnostic as to
whether the transforms are original Java transforms or perhaps not Java at all.
R: @tgroh
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kennknowles/beam
DirectRunner-RootInputProvider
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3217.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3217
----
commit 25bfac30c8fa90dec8ad25eb8248c67bb085c5fa
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-20T04:35:43Z
Make SdkComponents public for TransformPayloadTranslator
commit 8e9d864dc4d94d4f0b61c7e814d509628c25be28
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:26:44Z
Rename PCollections to PCollectionTranslation
This is to give a standard and obvious suffix for all our helper classes
for translating to/from Runner API protos.
commit d0f58e3c78fb1908a21fa81eb6d3088a622fbdc6
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:28:08Z
Rename PTransforms to PTransformTranslation
commit 409f5ee6310ba6e9c72876050f5fbc53467712d2
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:28:49Z
Rename ParDos to ParDoTranslation
commit cdd48237ee2c40fedf2eb2a80d91878276a804e6
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:29:16Z
Rename WindowIntoTranslator to WindowIntoTranslation
commit 40b614335e0dfc248d633e1ce3ca1ca4441fccd2
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:30:22Z
Rename ReadTranslator to ReadTranslation
commit 2c2117f83b0fad0d56862840a353c98ce3e387bf
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-20T03:54:36Z
Centralize primitive URNs in PTransforms class
commit fb963245f72b6761bf27629a34db9321c4c38b06
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-20T03:55:25Z
Allow getting URN for class of transform via translator
commit bfd07093f83e45c0055f8cf6eb4a63e566da0a5d
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-20T04:28:19Z
Add RawPTransform, which can just vend its URN and payload
This is the type that will be returned when a pipeline is deserialized.
This also is convenient for direct runner overrides which do not really
merit translator registrations, yet URNs need to be known in order to
key the evaluator registry off URN.
commit 0f9c20751f96bb480637afb818444cadd19e8258
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:31:49Z
Rename Coders to CoderTranslation
commit 2cb37ec1cff44d1d579afbd9896eacdd87381f54
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:32:47Z
Rename WindowingStrategies to WindowingStrategyTranslation
commit ea6534269fc46bd1c89f8125201cc0f7ca2f5791
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T22:33:33Z
Rename Triggers to TriggerTranslation
commit 183d1501b8b9923b9bba4ba1f98a8856899983bf
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T04:00:02Z
Add registration for Read and WindowInto translators
commit aacb1fe367362c4c8fd0c04fb9cd99d5c858cfc7
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T04:09:20Z
Register ReadTranslator
commit 081a4acb1bd36803902637d9efcb0b1c16c52f80
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T04:09:33Z
Register WindowIntoTranslator
commit b6ff3438ebea518979ed120687fb3006426b82e6
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-23T04:09:54Z
Add trivial FlattenTranslator to access URN
commit 9c08b1768dc31410756d0db895f0a3be7d8e16c7
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-20T03:53:32Z
Use URNs in DirectRunner evaluator registry
commit e4a10964f1064fd216b389089aa8520816c31645
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-24T04:15:48Z
Allow extraction of source from Read transform pre or post-hydration
commit 3620ad87cf45d4566f7e6c6a30384e82a6b95512
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-24T04:17:45Z
DirectRunner RootInputProvider registry via URN
----
> Rehydrate Pipeline from Runner API proto
> ----------------------------------------
>
> Key: BEAM-2333
> URL: https://issues.apache.org/jira/browse/BEAM-2333
> Project: Beam
> Issue Type: Bug
> Components: runner-core
> Reporter: Kenneth Knowles
> Assignee: Kenneth Knowles
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
