GitHub user jkff opened a pull request:
https://github.com/apache/beam/pull/2556
[BEAM-1983] Splittable DoFn changes for properly supporting side inputs
See https://issues.apache.org/jira/browse/BEAM-1983
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jkff/incubator-beam spd-fixes
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2556.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2556
----
commit 30caf69146c4699993469571927ef3809a1e6e2d
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-15T23:38:35Z
Separates side input test and side output test
commit 670b2325c3e2d97a2c34cd318417f982072646fb
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-15T23:39:51Z
ProcessFn remembers more info about its application context
commit 89759ea0778c4bc3b0e9b0edebb7283569321baf
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-17T19:25:02Z
Minor cleanups in ParDoEvaluator
commit cc34d5f3f1dee423c5d6df1845acdf89da80f2e3
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-17T21:41:53Z
Extracts interface from PushbackSideInputDoFnRunner
commit 37cba1531a5249ecb085776259c345638c6d8623
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-17T21:52:23Z
Creates ProcessFnRunner and wires it through ParDoEvaluator
commit b26c6ac9d7004e1e5e986ffa6326aa1565335662
Author: Eugene Kirpichov <[email protected]>
Date: 2017-04-17T18:28:24Z
Explodes windows before GBKIKWI
Also
* Adds a test for windowed side inputs that requires this
behavior.
* Adds a test category for SDF with windowed side input.
Runners should gradually implement this properly. For now
only direct runner implements this properly.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
